00000001:02000400:2.0F:1788309277.510968:0:2953:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg255-server.virtnet: executing set_hostid 00000001:02000400:3.0F:1788309294.752576:0:3176:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg255-server.virtnet: executing load_modules_local 00000001:01000000:2.0:1788309296.668115:0:3236:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 535 MB/s 00000001:01000000:2.0:1788309296.928029:0:3236:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 473 MB/s 00000001:01000000:0.0F:1788309297.177316:0:3236:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3595 MB/s 00000020:02000000:2.0:1788309297.861806:0:3268:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_45_g07d9be3 00000400:02000000:0.0:1788309298.855091:0:3283:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.202.155@tcp [8/256/0/180] 00008000:02000000:1.0F:1788309302.873124:0:3433:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1788309359.223677:0:5239:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg255-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1788309369.458702:0:5818:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788309369.458709:0:5818:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1788309369.458857:0:5818:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000002a418d65 00000080:02000400:0.0:1788309369.458868:0:5818:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:0.0:1788309369.464988:0:5818:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1788309369.465003:0:5818:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788309369.465044:0:5818:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000eab52b41) 00000020:00000080:0.0:1788309369.465073:0:5818:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788309369.497893:0:5818:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1788309369.498783:0:5818:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1788309369.526581:0:5818:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788309369.526708:0:5818:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788309369.526723:0:5818:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788309369.526754:0:5818:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788309369.526769:0:5818:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788309369.527047:0:5818:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788309369.527065:0:5818:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788309369.527077:0:5818:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x63a04852f4628305 00000020:01000004:2.0:1788309369.527084:0:5818:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1788309369.527088:0:5818:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788309369.527092:0:5818:0:(tgt_mount.c:101:server_register_mount()) register mount 000000002a418d65 from MGS 00000020:01000004:2.0:1788309369.527096:0:5818:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788309369.527116:0:5818:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000008459947f) 00000020:00000080:2.0:1788309369.527129:0:5818:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788309369.527199:0:5818:0:(tgt_mount.c:153:server_get_mount()) get mount 000000002a418d65 from MGS, refs=2 00080000:01000000:2.0:1788309369.527202:0:5818:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788309369.527206:0:5818:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x63a04852f4628313 00000100:00100000:2.0:1788309369.527364:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788309369.527786:0:5818:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788309369.527794:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788309369.528236:0:5818:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788309369.528243:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788309369.529126:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788309369.529250:0:5818:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788309369.529255:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788309369.529863:0:5818:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788309369.529868:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788309369.530127:0:5818:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788309369.530131:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788309369.530895:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309369.530898:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309369.530899:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309369.531134:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309369.531135:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309369.531136:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309369.531767:0:5818:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788309369.538534:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1788309369.781808:0:5818:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3043 MB/s 00000001:01000000:2.0:1788309370.031334:0:5818:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 4247 MB/s 00000001:01000000:2.0:1788309370.282700:0:5818:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 709 MB/s 00000001:01000000:0.0:1788309370.533077:0:5818:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 507 MB/s 00080000:10000000:1.0:1788309370.540216:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:1.0:1788309370.561845:0:5818:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1788309370.561930:0:5818:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788309370.561933:0:5818:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1788309370.565007:0:5828:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1788309370.565093:0:5818:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1788309370.565149:0:5818:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1788309370.565990:0:5818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1788309370.566019:0:5818:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1788309370.566500:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788309370.567828:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1788309370.567836:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788309370.584135:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788309370.584149:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1788309370.584697:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1788309370.584705:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788309370.586099:0:5818:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788309370.586125:0:5818:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.155@tcp' 00000020:01000004:3.0:1788309370.586127:0:5818:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788309370.586177:0:5818:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.155@tcp (typ=mgc) 00000020:00000080:3.0:1788309370.586199:0:5818:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.155@tcp (00000000d07930bf) 00000020:00000080:3.0:1788309370.586216:0:5818:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788309370.586379:0:5818:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000081f89803@MGC192.168.202.155@tcp: add connection 192.168.202.155@tcp at head 00010000:00010000:3.0:1788309370.586689:0:5818:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.155@tcp-0 is initialized 00000040:01000000:3.0:1788309370.586696:0:5818:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.155@tcp ctxt 1 is initialized 00000100:00080000:0.0:1788309370.587996:0:5833:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1788309370.592543:0:5834:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1788309370.592833:0:5818:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.155@tcp (uuid 00707c3b-bc67-4313-a42d-1f5d185ea5d5) 00000020:00000080:3.0:1788309370.592858:0:5818:0:(genops.c:1385:class_connect()) connect: client 00707c3b-bc67-4313-a42d-1f5d185ea5d5, cookie 0x63a04852f4628321 00000100:00080000:3.0:1788309370.592936:0:5818:0:(import.c:510:import_select_connection()) MGC192.168.202.155@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788309370.592941:0:5818:0:(import.c:624:import_select_connection()) MGC192.168.202.155@tcp: import 0000000081f89803 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:3.0:1788309370.592995:0:5818:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000007684e0fd x1875178210459776/t0(0) o250->MGC192.168.202.155@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788309370.593016:0:5818:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 00707c3b-bc67-4313-a42d-1f5d185ea5d5->MGS 00000020:01000004:3.0:1788309370.593035:0:5818:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788309370.593041:0:5818:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1788309370.593069:0:5818:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000004ed21391) 00000020:00000080:3.0:1788309370.593080:0:5818:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788309370.595600:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007684e0fd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3299:1875178210459776:0@lo:250: 00000100:00100000:0.0:1788309370.595696:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788309370.595757:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788309370.596193:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210459776 00000100:00100000:0.0:1788309370.596201:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210459776 00000100:00100000:0.0:1788309370.596229:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788309370.596235:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003ce015a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3299:x1875178210459776:12345-0@lo:250: 00010000:00080000:0.0:1788309370.596258:0:5830:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 00707c3b-bc67-4313-a42d-1f5d185ea5d5@0@lo t0 exp 0000000000000000 cur 133 last 0 00000020:00000080:0.0:1788309370.596313:0:5830:0:(genops.c:1385:class_connect()) connect: client 00707c3b-bc67-4313-a42d-1f5d185ea5d5, cookie 0x63a04852f462832f 00000100:00080000:0.0:1788309370.606408:0:5830:0:(import.c:65:import_set_state_nolock()) 000000008c98cc1d : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788309370.606511:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003ce015a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+5:3299:x1875178210459776:12345-0@lo:250: Request processed in 10272us (10812us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309370.606523:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788309370.606588:0:3299:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.202.155@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788309370.606599:0:3299:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.155@tcp: connect to target with instance 0 00000100:00080000:0.0:1788309370.606608:0:3299:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.155@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788309370.606613:0:3299:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788309370.606616:0:3299:0:(import.c:65:import_set_state_nolock()) 0000000081f89803 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788309370.606619:0:3299:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788309370.606628:0:3299:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788309370.606633:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007684e0fd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3299:1875178210459776:0@lo:250: 00000100:00100000:3.0:1788309370.619698:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788309370.619901:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788309370.619908:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1788309370.627391:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1788309370.627666:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788309370.628950:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788309370.628959:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788309370.631685:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788309370.631958:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788309370.631967:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1788309370.633067:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1788309370.633078:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1788309370.669236:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788309370.669694:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1788309370.669701:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1788309370.670856:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1788309370.670929:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1788309370.671759:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788309370.672001:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788309370.672007:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1788309370.674672:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788309370.674689:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1788309370.675462:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788309370.675719:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788309370.675724:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788309370.676350:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788309370.676359:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788309370.679226:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788309370.681111:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788309370.681121:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788309370.682022:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788309370.682031:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1788309370.712222:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788309370.712934:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788309370.712945:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788309370.715154:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788309370.715169:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788309370.717363:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788309370.717377:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788309370.718365:0:5818:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788309370.718388:0:5818:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1788309370.718404:0:5818:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.155@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788309370.718532:0:5818:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.155@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788309370.718696:0:5818:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.155@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1788309370.718701:0:5818:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788309370.718703:0:5818:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788309370.718704:0:5818:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788309370.718705:0:5818:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788309370.718706:0:5818:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788309370.718708:0:5818:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788309370.718709:0:5818:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788309370.718710:0:5818:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788309370.718712:0:5818:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788309370.718713:0:5818:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788309370.718714:0:5818:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788309370.718715:0:5818:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788309370.718718:0:5818:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1788309370.718720:0:5818:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788309370.718721:0:5818:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788309370.718722:0:5818:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788309370.718726:0:5818:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788309370.718727:0:5818:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788309370.718728:0:5818:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788309370.718729:0:5818:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788309370.718730:0:5818:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788309370.718731:0:5818:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788309370.718732:0:5818:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788309370.718732:0:5818:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788309370.718733:0:5818:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788309370.718776:0:5818:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788309370.718791:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000a00303f pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5818:1875178210459904:0@lo:253: 00000100:00100000:2.0:1788309370.718932:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309370.718986:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a1aacd05 going to sleep for 11 seconds 00000100:00100000:3.0:1788309370.719100:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210459904 00000100:00100000:3.0:1788309370.719108:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210459904 00000100:00100000:3.0:1788309370.719145:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788309370.719152:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000096cb12b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+5:5818:x1875178210459904:12345-0@lo:253: 20000000:01000000:3.0:1788309370.719193:0:5832:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788309370.719195:0:5832:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1788309370.719564:0:5853:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788309370.719661:0:5832:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1788309370.719960:0:5832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788309370.721171:0:5854:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1788309370.721676:0:5832:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788309370.721681:0:5832:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1788309370.721686:0:5832:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1788309370.721689:0:5832:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1788309370.721705:0:5832:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1788309370.722119:0:5832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788309370.722774:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1788309370.722791:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788309370.722845:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1788309370.722971:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1788309370.723009:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1788309370.723197:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1788309370.723206:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1788309370.723256:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1788309370.723264:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1788309370.723689:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1788309370.723700:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1788309370.723738:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1788309370.723794:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1788309370.723836:0:5832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1788309370.723842:0:5832:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1788309370.723857:0:5832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788309370.724194:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1788309370.724204:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788309370.724247:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1788309370.724519:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1788309370.724694:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1788309370.724708:0:5832:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1788309370.724796:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1788309370.724805:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788309370.724852:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1788309370.724968:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1788309370.725005:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1788309370.725017:0:5832:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1788309370.725179:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1788309370.725188:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1788309370.725219:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1788309370.725256:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1788309370.725684:0:5832:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1788309370.725726:0:5832:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1788309370.725733:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1788309370.726654:0:5855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1788309370.726825:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1788309370.726851:0:5832:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.155@tcp for mdt 20000000:01000000:2.0:1788309370.726853:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.155@tcp (null) (null) (null) 00000040:00080000:2.0:1788309370.726960:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1788309370.726968:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788309370.726992:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1788309370.726998:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.155@tcp (null) (null) 00000040:00080000:2.0:1788309370.727143:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1788309370.727156:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1788309370.727191:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1788309370.727227:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1788309370.727628:0:5832:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788309370.727632:0:5832:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788309370.727643:0:5832:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1788309370.727650:0:5832:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1788309370.728138:0:5856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:2.0:1788309370.728543:0:5832:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1788309370.748960:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1788309370.750207:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:1.0:1788309370.750350:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:1.0:1788309370.750372:0:5832:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788309370.750375:0:5832:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788309370.750378:0:5832:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788309370.750392:0:5832:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788309370.751025:0:5832:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788309370.751541:0:5832:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788309370.751614:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788309370.755426:0:5857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1788309370.756029:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1788309370.756167:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1788309370.756202:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:2.0:1788309370.756216:0:5832:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788309370.756219:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788309370.756970:0:5858:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:2.0:1788309370.757770:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:2.0:1788309370.757808:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:2.0:1788309370.757953:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 00000020:00000080:2.0:1788309370.757970:0:5832:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788309370.757972:0:5832:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:2.0:1788309370.757978:0:5832:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788309370.757997:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000fbfaa7b3/0x63a04852f4628336 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309370.758013:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fbfaa7b3/0x63a04852f4628336 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309370.758023:0:5832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000fbfaa7b3/0x63a04852f4628336 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309370.758028:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000fbfaa7b3/0x63a04852f4628336 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309370.758035:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000fbfaa7b3/0x63a04852f4628336 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309370.758054:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000fbfaa7b3/0x63a04852f4628336 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309370.758070:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000fbfaa7b3 already unused, calling callback (000000005b18c305) 00010000:00010000:2.0:1788309370.758074:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000fbfaa7b3/0x63a04852f4628336 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309370.758081:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000fbfaa7b3/0x63a04852f4628336 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309370.758094:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000fbfaa7b3/0x63a04852f4628336 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309370.758101:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000fbfaa7b3/0x63a04852f4628336 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309370.758107:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000fbfaa7b3/0x63a04852f4628336 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788309370.758122:0:5832:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788309371.024778:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000096cb12b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+5:5818:x1875178210459904:12345-0@lo:253: Request processed in 305618us (305838us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309371.024800:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788309371.024969:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000a00303f pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5818:1875178210459904:0@lo:253: 10000000:01000000:2.0:1788309371.024985:0:5818:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788309371.024988:0:5818:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788309371.024991:0:5818:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788309371.024992:0:5818:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788309371.024993:0:5818:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1788309371.024994:0:5818:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788309371.024995:0:5818:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788309371.024997:0:5818:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788309371.024999:0:5818:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788309371.025000:0:5818:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788309371.025002:0:5818:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788309371.025003:0:5818:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788309371.025022:0:5818:0:(tgt_mount.c:101:server_register_mount()) register mount 000000002a418d65 from lustre-MDT0000 10000000:01000000:2.0:1788309371.025058:0:5818:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788309371.025067:0:5818:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788309371.025071:0:5818:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff97c8e661b370 10000000:01000000:2.0:1788309371.025076:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788309371.025084:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff97c8e661b370 from 1 10000000:01000000:2.0:1788309371.025087:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788309371.025124:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: 00000000fbfaa7b3/0x63a04852f462833d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309371.025135:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: 00000000fbfaa7b3/0x63a04852f462833d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309371.025145:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: 00000000fbfaa7b3/0x63a04852f462833d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309371.025162:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000a00303f pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5818:1875178210460032:0@lo:101: 00000100:00100000:2.0:1788309371.025195:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309371.025257:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210460032 00000100:00100000:0.0:1788309371.025264:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210460032 00000100:00100000:0.0:1788309371.025336:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788309371.025344:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e5a68e14 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+5:5818:x1875178210460032:12345-0@lo:101: 00010000:00010000:0.0:1788309371.025365:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788309371.025379:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001183343d/0x63a04852f4628344 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x63a04852f462833d expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309371.025413:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001183343d/0x63a04852f4628344 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63a04852f462833d expref: 6 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309371.025422:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001183343d/0x63a04852f4628344 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f462833d expref: 6 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309371.025430:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001183343d, rc 0) 00000100:00100000:2.0:1788309371.027375:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 0000000039af8f7d going to sleep for 11 seconds 00000100:00100000:0.0:1788309371.027479:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e5a68e14 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+6:5818:x1875178210460032:12345-0@lo:101: Request processed in 2133us (2280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309371.027489:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788309371.027644:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000a00303f pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5818:1875178210460032:0@lo:101: 00010000:00010000:2.0:1788309371.027662:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: 00000000fbfaa7b3/0x63a04852f462833d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4628344 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309371.027673:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: 00000000fbfaa7b3/0x63a04852f462833d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x63a04852f4628344 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309371.027745:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000a00303f pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5818:1875178210460160:0@lo:501: 00000100:00100000:2.0:1788309371.027776:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309371.027796:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 0000000039af8f7d going to sleep for 11 seconds 00000100:00100000:1.0:1788309371.027970:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210460160 00000100:00100000:1.0:1788309371.027977:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210460160 00000100:00100000:1.0:1788309371.028031:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788309371.028050:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008371a355 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+6:5818:x1875178210460160:12345-0@lo:501: 00000100:00100000:1.0:1788309371.028341:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008371a355 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+6:5818:x1875178210460160:12345-0@lo:501: Request processed in 303us (565us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788309371.028349:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788309371.028501:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000a00303f pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5818:1875178210460160:0@lo:501: 10000000:01000000:2.0:1788309371.028524:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788309371.028538:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: 00000000fbfaa7b3/0x63a04852f462833d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4628344 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309371.028558:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: 00000000fbfaa7b3/0x63a04852f462833d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4628344 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788309371.028566:0:5818:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff97c8e07b1000 10000000:01000000:2.0:1788309371.028571:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788309371.028575:0:5818:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff97c8e07b1000 10000000:01000000:2.0:1788309371.028577:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788309371.028580:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff97c8e07b1000 from 1 10000000:01000000:2.0:1788309371.028583:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788309371.028603:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: 000000008bc4adf0/0x63a04852f462834b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309371.028609:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: 000000008bc4adf0/0x63a04852f462834b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309371.028617:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: 000000008bc4adf0/0x63a04852f462834b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309371.028628:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000a00303f pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5818:1875178210460288:0@lo:101: 00000100:00100000:2.0:1788309371.028656:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309371.028685:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 0000000039af8f7d going to sleep for 11 seconds 00000100:00100000:1.0:1788309371.029064:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210460288 00000100:00100000:1.0:1788309371.029069:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210460288 00000100:00100000:1.0:1788309371.029159:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788309371.029167:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000082e81bfe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+6:5818:x1875178210460288:12345-0@lo:101: 00010000:00010000:1.0:1788309371.029179:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788309371.029193:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002b25f4a8/0x63a04852f4628352 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x63a04852f462834b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309371.029212:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002b25f4a8/0x63a04852f4628352 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63a04852f462834b expref: 7 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309371.029221:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002b25f4a8/0x63a04852f4628352 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f462834b expref: 7 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309371.029229:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002b25f4a8, rc 0) 00000100:00100000:1.0:1788309371.029270:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000082e81bfe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+7:5818:x1875178210460288:12345-0@lo:101: Request processed in 104us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309371.029340:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788309371.029403:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000a00303f pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5818:1875178210460288:0@lo:101: 00010000:00010000:2.0:1788309371.029415:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: 000000008bc4adf0/0x63a04852f462834b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4628352 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309371.029422:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: 000000008bc4adf0/0x63a04852f462834b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x63a04852f4628352 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788309371.029448:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788309371.029499:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: 000000008bc4adf0/0x63a04852f462834b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4628352 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309371.029506:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: 000000008bc4adf0/0x63a04852f462834b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4628352 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788309371.029512:0:5818:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788309371.029516:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788309371.029521:0:5818:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff97c8e07b1000 10000000:01000000:2.0:1788309371.029524:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788309371.029527:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788309371.029529:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788309371.029555:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: 00000000783892a4/0x63a04852f4628359 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309371.029562:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: 00000000783892a4/0x63a04852f4628359 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309371.029568:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: 00000000783892a4/0x63a04852f4628359 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309371.029579:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000a00303f pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5818:1875178210460416:0@lo:101: 00000100:00100000:2.0:1788309371.029607:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309371.029779:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 0000000039af8f7d going to sleep for 11 seconds 00000100:00100000:3.0:1788309371.029966:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210460416 00000100:00100000:3.0:1788309371.029972:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210460416 00000100:00100000:3.0:1788309371.029998:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788309371.030004:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f2ba1da5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+7:5818:x1875178210460416:12345-0@lo:101: 00010000:00010000:3.0:1788309371.030013:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309371.030023:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000dd8c1685/0x63a04852f4628360 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x63a04852f4628359 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309371.030060:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000dd8c1685/0x63a04852f4628360 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63a04852f4628359 expref: 8 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309371.030069:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000dd8c1685/0x63a04852f4628360 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f4628359 expref: 8 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309371.030075:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000dd8c1685, rc 0) 00000100:00100000:3.0:1788309371.030126:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f2ba1da5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+8:5818:x1875178210460416:12345-0@lo:101: Request processed in 122us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309371.030132:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788309371.030258:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000a00303f pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5818:1875178210460416:0@lo:101: 00010000:00010000:2.0:1788309371.030268:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: 00000000783892a4/0x63a04852f4628359 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4628360 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309371.030302:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: 00000000783892a4/0x63a04852f4628359 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x63a04852f4628360 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309371.030344:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000a00303f pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5818:1875178210460544:0@lo:501: 00000100:00100000:2.0:1788309371.030369:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309371.030391:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 0000000039af8f7d going to sleep for 11 seconds 00000100:00100000:3.0:1788309371.030444:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210460544 00000100:00100000:3.0:1788309371.030448:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210460544 00000100:00100000:3.0:1788309371.030466:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788309371.030471:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000091d0db75 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+8:5818:x1875178210460544:12345-0@lo:501: 00000100:00100000:3.0:1788309371.030735:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000091d0db75 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+9:5818:x1875178210460544:12345-0@lo:501: Request processed in 263us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309371.030741:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788309371.030947:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000a00303f pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5818:1875178210460544:0@lo:501: 00000100:00100000:2.0:1788309371.030973:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000a00303f pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5818:1875178210460672:0@lo:503: 00000100:00100000:2.0:1788309371.031004:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309371.031028:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 0000000039af8f7d going to sleep for 11 seconds 00000100:00100000:3.0:1788309371.031084:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210460672 00000100:00100000:3.0:1788309371.031088:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210460672 00000100:00100000:3.0:1788309371.031103:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788309371.031108:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000013557c5c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+9:5818:x1875178210460672:12345-0@lo:503: 00000100:00100000:3.0:1788309371.031240:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000013557c5c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+9:5818:x1875178210460672:12345-0@lo:503: Request processed in 131us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309371.031246:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788309371.031331:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000a00303f pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5818:1875178210460672:0@lo:503: 00000100:00100000:2.0:1788309371.031813:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000a00303f pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5860:1875178210460800:0@lo:502: 00000100:00100000:2.0:1788309371.032019:0:5860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309371.032061:0:5860:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c5cd5e4d going to sleep for 11 seconds 00000100:00100000:3.0:1788309371.032121:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210460800 00000100:00100000:3.0:1788309371.032126:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210460800 00000100:00100000:3.0:1788309371.032146:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788309371.032157:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fd922be3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+9:5860:x1875178210460800:12345-0@lo:502: 00000100:00100000:2.0:1788309371.033808:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fd922be3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+9:5860:x1875178210460800:12345-0@lo:502: Request processed in 1646us (1785us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309371.033824:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788309371.034033:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000a00303f pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5860:1875178210460800:0@lo:502: 00000020:01000000:0.0:1788309371.034081:0:5860:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788309371.034092:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788309371.034094:0:5860:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788309371.034099:0:5860:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788309371.034102:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788309371.034115:0:5860:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000351ee620) 00000020:00000080:0.0:1788309371.034133:0:5860:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1788309371.034139:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788309371.034211:0:5860:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788309371.034217:0:5860:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x63a04852f462836e 00000020:00000080:0.0:1788309371.034444:0:5860:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788309371.034449:0:5860:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788309371.034452:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788309371.034454:0:5860:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788309371.034457:0:5860:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788309371.034470:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788309371.034471:0:5860:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788309371.034474:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788309371.034481:0:5860:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000880dc29e) 00000020:00000080:0.0:1788309371.034490:0:5860:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1788309371.034493:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788309371.034495:0:5860:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788309371.034497:0:5860:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788309371.034502:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788309371.034948:0:5860:0:(tgt_mount.c:153:server_get_mount()) get mount 000000002a418d65 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788309371.034965:0:5860:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000057d9ccb) 00000020:00000080:0.0:1788309371.034974:0:5860:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1788309371.035025:0:5860:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788309371.035058:0:5860:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x63a04852f4628383 00000020:00000080:0.0:1788309371.035160:0:5860:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788309371.035167:0:5860:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788309371.035172:0:5860:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x63a04852f462838a 00080000:01000000:0.0:1788309371.035177:0:5860:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788309371.035181:0:5860:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x63a04852f4628391 00080000:10000000:1.0:1788309371.036197:0:5860:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:1.0:1788309371.036440:0:5860:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1788309371.042658:0:5860:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1788309371.127324:0:5860:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1788309371.127663:0:5860:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1788309371.136587:0:5860:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1788309371.136890:0:5860:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788309371.228985:0:5860:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000003b64c6ae) 00000020:00000080:2.0:1788309371.229007:0:5860:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788309371.229093:0:5860:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788309371.229106:0:5860:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x63a04852f462839f 00000020:00000080:3.0:1788309371.241094:0:5860:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1788309371.249541:0:5860:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788309371.324448:0:5860:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788309371.364214:0:5860:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788309371.394919:0:5860:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788309371.441080:0:5860:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788309371.511092:0:5860:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:1.0:1788309371.544670:0:5860:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x63a04852f46283a6 00000020:00000080:1.0:1788309371.545274:0:5860:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788309371.545308:0:5860:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788309371.545315:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788309371.545317:0:5860:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788309371.545320:0:5860:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788309371.545338:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788309371.545340:0:5860:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788309371.545352:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788309371.545511:0:5860:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788309371.545529:0:5860:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788309371.545534:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788309371.545535:0:5860:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1788309371.545537:0:5860:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788309371.545539:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788309371.545540:0:5860:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788309371.545544:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788309371.545545:0:5860:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788309371.545600:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d163da63 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5860:1875178210460928:0@lo:502: 00000100:00100000:1.0:1788309371.545677:0:5860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309371.545726:0:5860:0:(client.c:2715:ptlrpc_set_wait()) set 000000006113f179 going to sleep for 11 seconds 00000100:00100000:2.0:1788309371.545820:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210460928 00000100:00100000:2.0:1788309371.545827:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210460928 00000100:00100000:2.0:1788309371.545869:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788309371.545877:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007f1f1257 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+9:5860:x1875178210460928:12345-0@lo:502: 00000100:00100000:2.0:1788309371.546274:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007f1f1257 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+9:5860:x1875178210460928:12345-0@lo:502: Request processed in 396us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309371.546302:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788309371.546597:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d163da63 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5860:1875178210460928:0@lo:502: 00000020:01000000:2.0:1788309371.546625:0:5860:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788309371.546631:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788309371.546632:0:5860:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788309371.546636:0:5860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1788309371.546756:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1788309371.546772:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788309371.546788:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: 00000000783892a4/0x63a04852f4628359 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4628360 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309371.546799:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: 00000000783892a4/0x63a04852f4628359 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4628360 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788309371.546806:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff97c8e07b1000 from 1 10000000:01000000:2.0:1788309371.546809:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788309371.546835:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: 00000000e9719e6a/0x63a04852f46283ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309371.546843:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: 00000000e9719e6a/0x63a04852f46283ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309371.546859:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: 00000000e9719e6a/0x63a04852f46283ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309371.546873:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b1f4630b pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5818:1875178210461056:0@lo:101: 00000100:00100000:2.0:1788309371.546906:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309371.546927:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d4bbec9b going to sleep for 11 seconds 00000100:00100000:1.0:1788309371.549213:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210461056 00000100:00100000:1.0:1788309371.549227:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210461056 00000100:00100000:1.0:1788309371.549304:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788309371.549314:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002d8b9ab6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+9:5818:x1875178210461056:12345-0@lo:101: 00010000:00010000:1.0:1788309371.549343:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788309371.549362:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f291674e/0x63a04852f46283b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x63a04852f46283ad expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309371.549555:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f291674e/0x63a04852f46283b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63a04852f46283ad expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309371.549568:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f291674e/0x63a04852f46283b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f46283ad expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309371.549577:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f291674e, rc 0) 00000100:00100000:1.0:1788309371.549657:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002d8b9ab6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+10:5818:x1875178210461056:12345-0@lo:101: Request processed in 344us (2750us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309371.549683:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788309371.549803:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b1f4630b pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5818:1875178210461056:0@lo:101: 00010000:00010000:2.0:1788309371.549824:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: 00000000e9719e6a/0x63a04852f46283ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f46283b4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309371.549833:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: 00000000e9719e6a/0x63a04852f46283ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x63a04852f46283b4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309371.550757:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b1f4630b pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5818:1875178210461184:0@lo:256: 00000100:00100000:2.0:1788309371.550810:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309371.550857:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d4bbec9b going to sleep for 11 seconds 00000100:00100000:0.0:1788309371.551026:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210461184 00000100:00100000:0.0:1788309371.551042:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210461184 00000100:00100000:0.0:1788309371.551085:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788309371.551093:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b3de826c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+10:5818:x1875178210461184:12345-0@lo:256: 20000000:01000000:0.0:1788309371.551110:0:5830:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788309371.551117:0:5830:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788309371.551184:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b3de826c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+10:5818:x1875178210461184:12345-0@lo:256: Request processed in 92us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309371.551191:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788309371.551265:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b1f4630b pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5818:1875178210461184:0@lo:256: 10000000:01000000:2.0:1788309371.552210:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788309371.552802:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: 00000000e9719e6a/0x63a04852f46283ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f46283b4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309371.552818:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: 00000000e9719e6a/0x63a04852f46283ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f46283b4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788309371.552828:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97c8e07b1000 from 1 10000000:01000000:2.0:1788309371.552832:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788309371.552883:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: 00000000bda9db79/0x63a04852f46283bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309371.552891:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: 00000000bda9db79/0x63a04852f46283bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309371.552900:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: 00000000bda9db79/0x63a04852f46283bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309371.552921:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b1f4630b pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5818:1875178210461312:0@lo:101: 00000100:00100000:2.0:1788309371.552985:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309371.553027:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d4bbec9b going to sleep for 11 seconds 00000100:00100000:1.0:1788309371.553132:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210461312 00000100:00100000:1.0:1788309371.553141:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210461312 00000100:00100000:1.0:1788309371.553266:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788309371.553297:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000005299857 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+10:5818:x1875178210461312:12345-0@lo:101: 00010000:00010000:1.0:1788309371.553309:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788309371.553333:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a7a7ee8c/0x63a04852f46283c2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x63a04852f46283bb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309371.553355:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a7a7ee8c/0x63a04852f46283c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63a04852f46283bb expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309371.553364:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a7a7ee8c/0x63a04852f46283c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f46283bb expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309371.553372:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a7a7ee8c, rc 0) 00000100:00100000:1.0:1788309371.553574:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000005299857 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+11:5818:x1875178210461312:12345-0@lo:101: Request processed in 300us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309371.553582:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788309371.553664:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b1f4630b pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5818:1875178210461312:0@lo:101: 00010000:00010000:2.0:1788309371.553677:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: 00000000bda9db79/0x63a04852f46283bb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f46283c2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309371.553684:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: 00000000bda9db79/0x63a04852f46283bb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x63a04852f46283c2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309371.553732:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b1f4630b pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5818:1875178210461440:0@lo:501: 00000100:00100000:2.0:1788309371.553759:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309371.553914:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d4bbec9b going to sleep for 11 seconds 00000100:00100000:3.0:1788309371.553987:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210461440 00000100:00100000:3.0:1788309371.553992:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210461440 00000100:00100000:3.0:1788309371.554015:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788309371.554021:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000048174da3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+11:5818:x1875178210461440:12345-0@lo:501: 00000100:00100000:2.0:1788309371.555890:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000048174da3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+11:5818:x1875178210461440:12345-0@lo:501: Request processed in 1865us (2127us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309371.555901:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788309371.556123:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b1f4630b pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5818:1875178210461440:0@lo:501: 00000100:00100000:3.0:1788309371.556173:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000008ca2262 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5818:1875178210461568:0@lo:503: 00000100:00100000:3.0:1788309371.556218:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309371.556252:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 000000001f52838c going to sleep for 11 seconds 00000100:00100000:2.0:1788309371.556333:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210461568 00000100:00100000:2.0:1788309371.556340:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210461568 00000100:00100000:2.0:1788309371.556370:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788309371.556378:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dcc4eee2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+11:5818:x1875178210461568:12345-0@lo:503: 00000040:00080000:2.0:1788309371.556683:0:5830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788309371.556725:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dcc4eee2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+11:5818:x1875178210461568:12345-0@lo:503: Request processed in 348us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309371.556733:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788309371.556839:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000008ca2262 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5818:1875178210461568:0@lo:503: 00000040:00080000:3.0:1788309371.557748:0:5864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1788309371.557915:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1788309371.557934:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788309371.557948:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: 00000000bda9db79/0x63a04852f46283bb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f46283c2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309371.557958:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: 00000000bda9db79/0x63a04852f46283bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f46283c2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788309371.558001:0:5818:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788309371.558004:0:5818:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff97c8e07b1000 10000000:01000000:2.0:1788309371.558007:0:5818:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff97c8e07b1000 10000000:01000000:2.0:1788309371.558011:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788309371.558016:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97c8e07b1000 from 1 10000000:01000000:2.0:1788309371.558018:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788309371.558058:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: 000000002b861676/0x63a04852f46283c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309371.558065:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: 000000002b861676/0x63a04852f46283c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309371.558074:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: 000000002b861676/0x63a04852f46283c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309371.558093:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000093dcceb1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5818:1875178210461696:0@lo:101: 00000100:00100000:2.0:1788309371.558134:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309371.558182:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d4bbec9b going to sleep for 11 seconds 00000100:00100000:3.0:1788309371.558303:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210461696 00000100:00100000:3.0:1788309371.558310:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210461696 00000100:00100000:3.0:1788309371.558352:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788309371.558359:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008f94382c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+11:5818:x1875178210461696:12345-0@lo:101: 00010000:00010000:3.0:1788309371.558369:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309371.558381:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000062021527/0x63a04852f46283d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x63a04852f46283c9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309371.558516:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000062021527/0x63a04852f46283d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63a04852f46283c9 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309371.558526:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000062021527/0x63a04852f46283d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f46283c9 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309371.558545:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000062021527, rc 0) 00000100:00100000:3.0:1788309371.558590:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008f94382c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+12:5818:x1875178210461696:12345-0@lo:101: Request processed in 231us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309371.558597:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788309371.558671:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000093dcceb1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5818:1875178210461696:0@lo:101: 00010000:00010000:1.0:1788309371.558684:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: 000000002b861676/0x63a04852f46283c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f46283d0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309371.558692:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: 000000002b861676/0x63a04852f46283c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x63a04852f46283d0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309371.558738:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000046b2caa9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5818:1875178210461824:0@lo:501: 00000100:00100000:1.0:1788309371.558764:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309371.558800:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 00000000220ae36e going to sleep for 11 seconds 00000100:00100000:3.0:1788309371.558847:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210461824 00000100:00100000:3.0:1788309371.558852:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210461824 00000100:00100000:3.0:1788309371.558881:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788309371.558887:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d34d0f2a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+12:5818:x1875178210461824:12345-0@lo:501: 00000100:00100000:3.0:1788309371.559801:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d34d0f2a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+12:5818:x1875178210461824:12345-0@lo:501: Request processed in 911us (1032us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309371.559811:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788309371.559896:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000046b2caa9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5818:1875178210461824:0@lo:501: 00000100:00100000:1.0:1788309371.559930:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000046b2caa9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5818:1875178210461952:0@lo:503: 00000100:00100000:1.0:1788309371.559967:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309371.559994:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 00000000220ae36e going to sleep for 11 seconds 00000100:00100000:2.0:1788309371.560084:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210461952 00000100:00100000:2.0:1788309371.560090:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210461952 00000100:00100000:2.0:1788309371.560115:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788309371.560121:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c50b6a76 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+12:5818:x1875178210461952:12345-0@lo:503: 00000100:00100000:2.0:1788309371.560867:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c50b6a76 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+12:5818:x1875178210461952:12345-0@lo:503: Request processed in 743us (897us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309371.560876:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788309371.561064:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000046b2caa9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5818:1875178210461952:0@lo:503: 00000100:00100000:0.0:1788309371.561829:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002a8ee1b4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5865:1875178210462080:0@lo:502: 00000100:00100000:0.0:1788309371.561879:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309371.561951:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f8a5753f going to sleep for 11 seconds 00000100:00100000:3.0:1788309371.562000:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210462080 00000100:00100000:3.0:1788309371.562006:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210462080 00000100:00100000:3.0:1788309371.562077:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788309371.562086:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000006d2d40e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+12:5865:x1875178210462080:12345-0@lo:502: 00000100:00100000:3.0:1788309371.562553:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000006d2d40e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+12:5865:x1875178210462080:12345-0@lo:502: Request processed in 468us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309371.562561:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788309371.562721:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002a8ee1b4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5865:1875178210462080:0@lo:502: 00000020:01000004:0.0:1788309371.562785:0:5865:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788309371.562812:0:5865:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000598aa432) 00000020:00000080:0.0:1788309371.562835:0:5865:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1788309371.562914:0:5865:0:(tgt_mount.c:153:server_get_mount()) get mount 000000002a418d65 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788309371.562918:0:5865:0:(tgt_mount.c:187:server_put_mount()) put mount 000000002a418d65 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788309371.562921:0:5865:0:(obd_mount.c:710:lustre_put_lsi()) put 000000002a418d65 4 00010000:00080000:0.0:1788309371.562953:0:5865:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000e914334f@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.155@tcp at head 00010000:00010000:0.0:1788309371.565129:0:5865:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1788309371.566500:0:5865:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788309371.566558:0:5865:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788309371.566570:0:5865:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x63a04852f46283de 00000100:00080000:0.0:1788309371.566581:0:5865:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788309371.566585:0:5865:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000e914334f using connection 192.168.202.155@tcp/0@lo 00000100:00100000:0.0:1788309371.566621:0:5865:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000002a8ee1b4 x1875178210462208/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788309371.566679:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002a8ee1b4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875178210462208:0@lo:38: 00000100:00100000:2.0:1788309371.566750:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309371.566844:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210462208 00000100:00100000:3.0:1788309371.566852:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210462208 00000100:00100000:3.0:1788309371.566888:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788309371.566896:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b5aa1721 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3299:x1875178210462208:12345-0@lo:38: 00000100:00080000:0.0:1788309371.566966:0:5865:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788309371.574515:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b5aa1721 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3299:x1875178210462208:12345-0@lo:38: Request processed in 7611us (7757us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788309371.574531:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788309371.574844:0:3299:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788309371.574852:0:3299:0:(import.c:65:import_set_state_nolock()) 00000000e914334f lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788309371.574857:0:3299:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788309371.574860:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002a8ee1b4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875178210462208:0@lo:38: 00000100:00100000:0.0:1788309371.575104:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ed3b46e0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5865:1875178210462336:0@lo:502: 00000100:00100000:0.0:1788309371.575180:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309371.575224:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set 000000009e74d312 going to sleep for 11 seconds 00000100:00100000:2.0:1788309371.575272:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210462336 00000100:00100000:2.0:1788309371.575309:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210462336 00000100:00100000:2.0:1788309371.575360:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788309371.575369:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009aff9904 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+12:5865:x1875178210462336:12345-0@lo:502: 00000100:00100000:2.0:1788309371.575711:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009aff9904 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+12:5865:x1875178210462336:12345-0@lo:502: Request processed in 342us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309371.575718:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788309371.575829:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ed3b46e0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5865:1875178210462336:0@lo:502: 00000040:00080000:3.0:1788309371.575854:0:5865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1788309371.575985:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1788309371.576003:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788309371.576024:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: 000000002b861676/0x63a04852f46283c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f46283d0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309371.576043:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: 000000002b861676/0x63a04852f46283c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f46283d0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788309371.576096:0:5818:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788309371.576098:0:5818:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788309371.576099:0:5818:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788309371.576100:0:5818:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788309371.576102:0:5818:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788309371.576103:0:5818:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788309371.576104:0:5818:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788309371.576106:0:5818:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788309371.576107:0:5818:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788309371.576108:0:5818:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788309371.576109:0:5818:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788309371.576111:0:5818:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788309371.576114:0:5818:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1788309371.576116:0:5818:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788309371.576117:0:5818:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788309371.576118:0:5818:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788309371.576120:0:5818:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788309371.576120:0:5818:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788309371.576121:0:5818:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788309371.576122:0:5818:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788309371.576123:0:5818:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788309371.576124:0:5818:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788309371.576125:0:5818:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788309371.576126:0:5818:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788309371.576126:0:5818:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788309371.576142:0:5818:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788309371.576152:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b4a3f454 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5818:1875178210462464:0@lo:253: 00000100:00100000:2.0:1788309371.576186:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309371.576206:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a1aacd05 going to sleep for 11 seconds 00000100:00100000:3.0:1788309371.576257:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210462464 00000100:00100000:3.0:1788309371.576262:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210462464 00000100:00100000:3.0:1788309371.576318:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788309371.576334:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b99aeb73 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+12:5818:x1875178210462464:12345-0@lo:253: 20000000:01000000:3.0:1788309371.576364:0:5831:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788309371.576378:0:5831:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788309371.613930:0:5831:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788309371.613982:0:5831:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00010000:00010000:2.0:1788309371.616552:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:3.0:1788309371.618065:0:5853:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788309371.618074:0:5853:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788309371.618149:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000002ba51ed4/0x63a04852f46283e5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309371.618169:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f291674e/0x63a04852f46283b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f46283ad expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309371.618177:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000002ba51ed4/0x63a04852f46283e5 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309371.618233:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f291674e/0x63a04852f46283b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x63a04852f46283ad expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309371.618247:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f291674e/0x63a04852f46283b4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x63a04852f46283ad expref: 12 pid: 5831 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309371.618260:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b316cd87 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5853:1875178210462592:0@lo:104: 00000100:00100000:0.0:1788309371.618360:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309371.618437:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set 0000000020a46a34 going to sleep for 11 seconds 00000100:00100000:2.0:1788309371.618716:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210462592 00000100:00100000:2.0:1788309371.618724:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210462592 00000100:00100000:2.0:1788309371.618777:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788309371.618796:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a040cc6b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+3:5853:x1875178210462592:12345-0@lo:104: 00010000:00010000:2.0:1788309371.618808:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: 00000000e9719e6a/0x63a04852f46283ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x63a04852f46283b4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309371.618874:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788309371.618879:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a040cc6b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+3:5853:x1875178210462592:12345-0@lo:104: Request processed in 87us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309371.618886:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1788309371.618907:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788309371.618912:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: 00000000e9719e6a/0x63a04852f46283ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x63a04852f46283b4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309371.618919:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e9719e6a already unused, calling callback (00000000d3ac3a9f) 10000000:00010000:2.0:1788309371.618922:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: 00000000e9719e6a/0x63a04852f46283ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x63a04852f46283b4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309371.618929:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: 00000000e9719e6a/0x63a04852f46283ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x63a04852f46283b4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788309371.618936:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: 00000000e9719e6a/0x63a04852f46283ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x63a04852f46283b4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788309371.618942:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788309371.618968:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: 00000000e9719e6a/0x63a04852f46283ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f46283b4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309371.618975:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788309371.618990:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: 00000000e9719e6a/0x63a04852f46283ad lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f46283b4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309371.619005:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: 00000000e9719e6a/0x63a04852f46283ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f46283b4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309371.619022:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309371.619024:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309371.619025:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788309371.619115:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f5af7a78 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3301:1875178210462720:0@lo:103: 00000100:00100000:2.0:1788309371.619146:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309371.619207:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210462720 00000100:00100000:2.0:1788309371.619212:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210462720 00010000:00010000:2.0:1788309371.619228:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f291674e/0x63a04852f46283b4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63a04852f46283ad expref: 13 pid: 5831 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309371.619250:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788309371.619256:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f199b965 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+13:3301:x1875178210462720:12345-0@lo:103: 00010000:00010000:2.0:1788309371.619266:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788309371.619270:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f291674e/0x63a04852f46283b4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63a04852f46283ad expref: 13 pid: 5831 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309371.619313:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f291674e/0x63a04852f46283b4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x63a04852f46283ad expref: 13 pid: 5831 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309371.619380:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000002ba51ed4/0x63a04852f46283e5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309371.619448:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002ba51ed4/0x63a04852f46283e5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788309371.619463:0:5821:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001389685s 00010000:00010000:2.0:1788309371.619470:0:5821:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002ba51ed4/0x63a04852f46283e5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309371.619477:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002ba51ed4/0x63a04852f46283e5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309371.619483:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000002ba51ed4/0x63a04852f46283e5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309371.619488:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000002ba51ed4/0x63a04852f46283e5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309371.619493:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002ba51ed4 already unused, calling callback (000000005b18c305) 00010000:00010000:2.0:1788309371.619496:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000002ba51ed4/0x63a04852f46283e5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309371.619502:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000002ba51ed4/0x63a04852f46283e5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309371.619510:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000002ba51ed4/0x63a04852f46283e5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309371.619518:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788309371.619548:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f199b965 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+13:3301:x1875178210462720:12345-0@lo:103: Request processed in 291us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309371.619554:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788309371.619599:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f5af7a78 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3301:1875178210462720:0@lo:103: 00010000:00010000:0.0:1788309371.619729:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f291674e/0x63a04852f46283b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x63a04852f46283ad expref: 12 pid: 5831 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309371.619739:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b316cd87 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5853:1875178210462592:0@lo:104: 00010000:00010000:0.0:1788309371.619751:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000002ba51ed4/0x63a04852f46283e5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309371.619758:0:5853:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000002ba51ed4/0x63a04852f46283e5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309371.619762:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000002ba51ed4/0x63a04852f46283e5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309371.619767:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002ba51ed4/0x63a04852f46283e5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309371.623194:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b99aeb73 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+11:5818:x1875178210462464:12345-0@lo:253: Request processed in 46863us (47000us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309371.623211:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788309371.623343:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b4a3f454 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5818:1875178210462464:0@lo:253: 10000000:01000000:3.0:1788309371.623359:0:5818:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788309371.623362:0:5818:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788309371.623364:0:5818:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788309371.623365:0:5818:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788309371.623366:0:5818:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788309371.623367:0:5818:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788309371.623368:0:5818:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788309371.623370:0:5818:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788309371.623371:0:5818:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788309371.623373:0:5818:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788309371.623374:0:5818:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788309371.623375:0:5818:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788309371.623377:0:5818:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788309371.623399:0:5818:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788309371.628544:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1788309371.628929:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788309371.629136:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1788309371.629513:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788309371.629717:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1788309371.629879:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1788309371.631227:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1788309371.633910:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1788309371.634176:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1788309371.634675:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1788309371.634874:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1788309371.635062:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:3.0:1788309371.716144:0:5818:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1788309371.752008:0:5818:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1788309371.752331:0:5871:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1788309371.755267:0:5818:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788309371.756272:0:5818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788309371.756802:0:5818:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788309371.756813:0:5818:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788309371.756971:0:5818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:1.0:1788309371.757086:0:5870:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1788309371.757091:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:00080000:3.0:1788309371.758432:0:5818:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788309371.758953:0:5818:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788309371.758982:0:5818:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1788309371.759372:0:5818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1788309371.759656:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1788309371.765184:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1788309371.765370:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1788309371.765801:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1788309371.765957:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1788309371.766145:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1788309371.766324:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1788309371.766601:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1788309371.766738:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1788309371.766887:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1788309371.767007:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1788309371.767158:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1788309371.767525:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1788309371.767663:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1788309371.767786:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1788309371.767915:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1788309371.768028:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1788309371.768357:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1788309371.768563:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1788309371.768719:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1788309371.768878:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1788309371.769004:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1788309371.769165:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1788309371.769358:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1788309371.769498:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1788309371.769597:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1788309371.769744:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1788309371.769869:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1788309371.769963:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1788309371.770166:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1788309371.771202:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1788309371.771382:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1788309371.771520:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1788309371.771669:0:5818:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:3.0:1788309371.809176:0:5871:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:3.0:1788309371.842953:0:5818:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788309371.842989:0:5818:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbd5e01d37988 00100000:10000000:3.0:1788309371.842997:0:5818:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1788309371.843222:0:5818:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788309371.843238:0:5818:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.155@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788309371.843252:0:5818:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1788309371.843297:0:5818:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:0.0:1788309371.892703:0:5871:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788309371.892786:0:5871:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788309371.892791:0:5871:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1788309372.643658:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309373.667581:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309374.689342:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309375.717415:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788309375.824712:0:6113:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg255-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788309376.737022:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788309376.995596:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788309376.995607:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788309376.995610:0:36:0:(import.c:65:import_set_state_nolock()) 00000000e914334f lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788309376.995622:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000e914334f using connection 192.168.202.155@tcp/0@lo 00000100:00100000:1.0:1788309376.995642:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000005daa10f3 x1875178210462976/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788309376.995748:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005daa10f3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875178210462976:0@lo:38: 00000100:00100000:2.0:1788309376.995854:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309376.996016:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a3739f8a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3302:1875178210462848:0@lo:400: 00000100:00100000:0.0:1788309376.996051:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309376.996127:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210462976 00000100:00100000:0.0:1788309376.996136:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210462976 00000100:00100000:0.0:1788309376.996166:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788309376.996172:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f5af7a78 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3299:x1875178210462976:12345-0@lo:38: 00010000:00080000:0.0:1788309376.996195:0:5839:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 139 last 0 00000020:00000080:0.0:1788309376.996226:0:5839:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x63a04852f46283ec 00000004:00100000:0.0:1788309376.996267:0:5839:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788309376.996405:0:5839:0:(import.c:65:import_set_state_nolock()) 00000000d05d972d : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788309376.996460:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f5af7a78 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875178210462976:12345-0@lo:38: Request processed in 286us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309376.996468:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788309376.996513:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000005daa10f3 x1875178210462976/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788309386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788309376.996528:0:3299:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788309376.996535:0:3299:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788309376.996539:0:3299:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788309376.996540:0:3299:0:(import.c:65:import_set_state_nolock()) 00000000e914334f lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788309376.996545:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005daa10f3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875178210462976:0@lo:38: 00000100:00100000:2.0:1788309376.996806:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210462848 00000100:00100000:2.0:1788309376.996811:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210462848 00000100:00100000:2.0:1788309376.996852:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788309376.996860:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ae3e4ffb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+11:3302:x1875178210462848:12345-0@lo:400: 00000100:00100000:2.0:1788309376.996896:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ae3e4ffb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+11:3302:x1875178210462848:12345-0@lo:400: Request processed in 38us (844us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309376.996902:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788309376.996974:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a3739f8a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3302:1875178210462848:0@lo:400: 10000000:01000000:3.0:1788309377.509493:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788309377.509502:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff97c8e07b1000 from 3 10000000:01000000:3.0:1788309377.509512:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788309377.509558:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: 0000000076b14d99/0x63a04852f46283f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309377.509572:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: 0000000076b14d99/0x63a04852f46283f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309377.509583:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: 0000000076b14d99/0x63a04852f46283f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309377.509605:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000008ca2262 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210463104:0@lo:101: 00000100:00100000:3.0:1788309377.509678:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309377.509724:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ee0fa3d7 going to sleep for 11 seconds 00000100:00100000:2.0:1788309377.509905:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210463104 00000100:00100000:2.0:1788309377.509914:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210463104 00000100:00100000:2.0:1788309377.509957:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788309377.509965:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000927eb989 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+11:5834:x1875178210463104:12345-0@lo:101: 00010000:00010000:2.0:1788309377.509978:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309377.510001:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008a614ec5/0x63a04852f46283fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x63a04852f46283f3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309377.510023:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008a614ec5/0x63a04852f46283fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63a04852f46283f3 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309377.510044:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008a614ec5/0x63a04852f46283fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f46283f3 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309377.510053:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008a614ec5, rc 0) 00000100:00100000:2.0:1788309377.510094:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000927eb989 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+12:5834:x1875178210463104:12345-0@lo:101: Request processed in 130us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309377.510101:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788309377.511412:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000008ca2262 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210463104:0@lo:101: 00010000:00010000:2.0:1788309377.511437:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: 0000000076b14d99/0x63a04852f46283f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f46283fa expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309377.511446:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: 0000000076b14d99/0x63a04852f46283f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x63a04852f46283fa expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309377.511511:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000006604b05 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210463232:0@lo:256: 00000100:00100000:2.0:1788309377.511557:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309377.513951:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 000000009b99d083 going to sleep for 11 seconds 00000100:00100000:0.0:1788309377.515334:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210463232 00000100:00100000:0.0:1788309377.515346:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210463232 00000100:00100000:0.0:1788309377.515393:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788309377.515401:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007f575081 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+12:5834:x1875178210463232:12345-0@lo:256: 20000000:01000000:0.0:1788309377.515423:0:5832:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788309377.515449:0:5832:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788309377.515452:0:5832:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1788309377.515574:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007f575081 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+12:5834:x1875178210463232:12345-0@lo:256: Request processed in 173us (4016us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309377.515582:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788309377.516026:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000006604b05 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210463232:0@lo:256: 10000000:01000000:0.0:1788309377.516074:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788309377.516084:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: 0000000076b14d99/0x63a04852f46283f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f46283fa expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309377.516094:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: 0000000076b14d99/0x63a04852f46283f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f46283fa expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309377.761409:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309378.784580:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309379.809391:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309380.835727:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309381.857395:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788309382.120200:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007543106a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3303:1875178210463360:0@lo:400: 00000100:00100000:3.0:1788309382.120272:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309382.120372:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210463360 00000100:00100000:3.0:1788309382.120380:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210463360 00000100:00100000:3.0:1788309382.120442:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788309382.120452:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000097bbbc12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+12:3303:x1875178210463360:12345-0@lo:400: 00000100:00100000:3.0:1788309382.120501:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000097bbbc12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+12:3303:x1875178210463360:12345-0@lo:400: Request processed in 51us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309382.120508:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788309382.126706:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000385cd36c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875178210463488:0@lo:400: 00000100:00100000:1.0:1788309382.126789:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309382.129967:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007543106a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3303:1875178210463360:0@lo:400: 00000100:00100000:2.0:1788309382.130336:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210463488 00000100:00100000:2.0:1788309382.130344:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210463488 00000100:00100000:2.0:1788309382.130389:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788309382.130397:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ab24f8f9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875178210463488:12345-0@lo:400: 00000100:00100000:2.0:1788309382.143557:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ab24f8f9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875178210463488:12345-0@lo:400: Request processed in 13150us (16758us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309382.143576:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788309382.144200:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000385cd36c x1875178210463488/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788309382.144217:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000385cd36c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875178210463488:0@lo:400: 00000020:00000080:0.0:1788309382.231756:0:6315:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd4c8ff250 20000000:00000080:0.0:1788309382.231837:0:6315:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff97c8edd21400 uarg=0000000000000000 20000000:01000000:0.0:1788309382.231903:0:6315:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1788309382.231910:0:6315:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1788309382.231914:0:6315:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788309382.232199:0:6315:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1788309382.232213:0:6315:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1788309382.245893:0:6315:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788309382.246200:0:6315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788309382.246646:0:6315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1788309382.246706:0:6315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1788309382.246724:0:6315:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788309382.246913:0:6315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000f291674e/0x63a04852f4628401 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309382.246954:0:6315:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000a7a7ee8c/0x63a04852f46283c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f46283bb expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309382.246963:0:6315:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000f291674e/0x63a04852f4628401 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309382.247003:0:6315:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000a7a7ee8c/0x63a04852f46283c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x63a04852f46283bb expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309382.247018:0:6315:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000a7a7ee8c/0x63a04852f46283c2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x63a04852f46283bb expref: 11 pid: 5831 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309382.247033:0:6315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000044b77fec pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6315:1875178210463616:0@lo:104: 00000100:00100000:1.0:1788309382.247098:0:6315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309382.247206:0:6315:0:(client.c:2715:ptlrpc_set_wait()) set 0000000077fbdc59 going to sleep for 11 seconds 00000100:00100000:3.0:1788309382.249877:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210463616 00000100:00100000:3.0:1788309382.249891:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210463616 00000100:00100000:3.0:1788309382.250041:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788309382.250052:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f66288bf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+3:6315:x1875178210463616:12345-0@lo:104: 00010000:00010000:3.0:1788309382.250086:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: 00000000bda9db79/0x63a04852f46283bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x63a04852f46283c2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309382.250186:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788309382.250192:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f66288bf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+3:6315:x1875178210463616:12345-0@lo:104: Request processed in 143us (3095us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309382.250199:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788309382.250361:0:6315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000044b77fec pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6315:1875178210463616:0@lo:104: 00010000:00010000:1.0:1788309382.250383:0:6315:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000f291674e/0x63a04852f4628401 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309382.250452:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788309382.250458:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: 00000000bda9db79/0x63a04852f46283bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x63a04852f46283c2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309382.250467:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000bda9db79 already unused, calling callback (00000000d3ac3a9f) 10000000:00010000:2.0:1788309382.250470:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: 00000000bda9db79/0x63a04852f46283bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x63a04852f46283c2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309382.250476:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: 00000000bda9db79/0x63a04852f46283bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x63a04852f46283c2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788309382.250482:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: 00000000bda9db79/0x63a04852f46283bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x63a04852f46283c2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788309382.250488:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788309382.250529:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: 00000000bda9db79/0x63a04852f46283bb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f46283c2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309382.250546:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788309382.250565:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: 00000000bda9db79/0x63a04852f46283bb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f46283c2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309382.250571:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: 00000000bda9db79/0x63a04852f46283bb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f46283c2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309382.250592:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309382.250594:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309382.250596:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788309382.250608:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b2fef29d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3301:1875178210463744:0@lo:103: 00000100:00100000:2.0:1788309382.250648:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309382.250693:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210463744 00000100:00100000:2.0:1788309382.250705:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210463744 00010000:00010000:2.0:1788309382.250724:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000a7a7ee8c/0x63a04852f46283c2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63a04852f46283bb expref: 12 pid: 5831 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309382.250758:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788309382.250772:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f3b1e9a9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+12:3301:x1875178210463744:12345-0@lo:103: 00010000:00010000:2.0:1788309382.250783:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788309382.250787:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: 00000000a7a7ee8c/0x63a04852f46283c2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63a04852f46283bb expref: 12 pid: 5831 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309382.250796:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000a7a7ee8c/0x63a04852f46283c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x63a04852f46283bb expref: 12 pid: 5831 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309382.250808:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a7a7ee8c/0x63a04852f46283c2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x63a04852f46283bb expref: 12 pid: 5831 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309382.250821:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000f291674e/0x63a04852f4628401 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309382.250827:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f291674e/0x63a04852f4628401 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309382.250840:0:5821:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f291674e/0x63a04852f4628401 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309382.250846:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f291674e/0x63a04852f4628401 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309382.250852:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000f291674e/0x63a04852f4628401 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309382.250857:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000f291674e/0x63a04852f4628401 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309382.250869:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f291674e already unused, calling callback (000000005b18c305) 00010000:00010000:2.0:1788309382.250872:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000f291674e/0x63a04852f4628401 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309382.250878:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000f291674e/0x63a04852f4628401 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309382.250888:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000f291674e/0x63a04852f4628401 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309382.250897:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788309382.250926:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f3b1e9a9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+11:3301:x1875178210463744:12345-0@lo:103: Request processed in 156us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309382.250933:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788309382.250973:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b2fef29d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3301:1875178210463744:0@lo:103: 00010000:00010000:1.0:1788309382.251036:0:6315:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000f291674e/0x63a04852f4628401 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309382.251043:0:6315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000f291674e/0x63a04852f4628401 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309382.251048:0:6315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f291674e/0x63a04852f4628401 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309382.880485:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309383.912677:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309384.929703:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788309385.440389:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788309385.440413:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97c8e07b1000 from 1 10000000:01000000:1.0:1788309385.440418:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788309385.440464:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: 0000000069500209/0x63a04852f4628408 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309385.440476:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: 0000000069500209/0x63a04852f4628408 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309385.440487:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: 0000000069500209/0x63a04852f4628408 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309385.440512:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000044b77fec pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210463872:0@lo:101: 00000100:00100000:1.0:1788309385.440598:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309385.440665:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 000000000e8b023f going to sleep for 11 seconds 00000100:00100000:0.0:1788309385.440802:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210463872 00000100:00100000:0.0:1788309385.440810:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210463872 00000100:00100000:0.0:1788309385.440876:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788309385.440885:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f7d828e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+11:5834:x1875178210463872:12345-0@lo:101: 00010000:00010000:0.0:1788309385.440899:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788309385.440919:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004ff3ebed/0x63a04852f462840f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x63a04852f4628408 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309385.440942:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004ff3ebed/0x63a04852f462840f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63a04852f4628408 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309385.440960:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004ff3ebed/0x63a04852f462840f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f4628408 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309385.440976:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004ff3ebed, rc 0) 00000100:00100000:0.0:1788309385.441025:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f7d828e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+12:5834:x1875178210463872:12345-0@lo:101: Request processed in 141us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309385.441325:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000044b77fec pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210463872:0@lo:101: 00010000:00010000:1.0:1788309385.441343:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: 0000000069500209/0x63a04852f4628408 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f462840f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309385.441353:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: 0000000069500209/0x63a04852f4628408 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x63a04852f462840f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309385.441422:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000044b77fec pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210464000:0@lo:501: 00000100:00100000:1.0:1788309385.441451:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309385.441476:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 000000000e8b023f going to sleep for 11 seconds 00000100:00100000:0.0:1788309385.441533:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788309385.441563:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210464000 00000100:00100000:0.0:1788309385.441567:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210464000 00000100:00100000:0.0:1788309385.441585:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788309385.441590:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cc3edf36 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+12:5834:x1875178210464000:12345-0@lo:501: 00000100:00100000:0.0:1788309385.441899:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cc3edf36 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+12:5834:x1875178210464000:12345-0@lo:501: Request processed in 308us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309385.441907:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788309385.442191:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000044b77fec pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210464000:0@lo:501: 00000100:00100000:1.0:1788309385.442223:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000044b77fec pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210464128:0@lo:503: 00000100:00100000:1.0:1788309385.442300:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309385.442330:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 000000000e8b023f going to sleep for 11 seconds 00000100:00100000:2.0:1788309385.442476:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210464128 00000100:00100000:2.0:1788309385.442482:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210464128 00000100:00100000:2.0:1788309385.442517:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788309385.442527:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005c0b93fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+12:5834:x1875178210464128:12345-0@lo:503: 00000100:00100000:2.0:1788309385.442669:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005c0b93fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+12:5834:x1875178210464128:12345-0@lo:503: Request processed in 145us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309385.442676:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788309385.442717:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000044b77fec pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210464128:0@lo:503: 00000100:00100000:3.0:1788309385.443460:0:6433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007543106a pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:6433:1875178210464256:0@lo:502: 00000100:00100000:3.0:1788309385.443693:0:6433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309385.444114:0:6433:0:(client.c:2715:ptlrpc_set_wait()) set 000000002189f283 going to sleep for 11 seconds 00000100:00100000:1.0:1788309385.445127:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210464256 00000100:00100000:1.0:1788309385.445137:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210464256 00000100:00100000:1.0:1788309385.445181:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788309385.445190:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000009752792 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+12:6433:x1875178210464256:12345-0@lo:502: 00000100:00100000:1.0:1788309385.445660:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000009752792 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+12:6433:x1875178210464256:12345-0@lo:502: Request processed in 470us (1966us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309385.445669:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788309385.445802:0:6433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007543106a pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:6433:1875178210464256:0@lo:502: 00000020:01000000:0.0:1788309385.445835:0:6433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788309385.445844:0:6433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788309385.445846:0:6433:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788309385.445977:0:6433:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97c8e07b1000 00000020:00000080:0.0:1788309385.445982:0:6433:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788309385.446253:0:6433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8c89fa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:6433:1875178210464384:0@lo:502: 00000100:00100000:1.0:1788309385.446497:0:6433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309385.446536:0:6433:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c3386900 going to sleep for 11 seconds 00000100:00100000:2.0:1788309385.446541:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210464384 00000100:00100000:2.0:1788309385.446548:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210464384 00000100:00100000:2.0:1788309385.446595:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788309385.446602:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+12:6433:x1875178210464384:12345-0@lo:502: 00000100:00100000:2.0:1788309385.446829:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+12:6433:x1875178210464384:12345-0@lo:502: Request processed in 226us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309385.446837:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788309385.447573:0:6433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8c89fa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:6433:1875178210464384:0@lo:502: 00000020:01000000:0.0:1788309385.447603:0:6433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788309385.447610:0:6433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788309385.447612:0:6433:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788309385.447618:0:6433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1788309385.447727:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788309385.447749:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788309385.447759:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c9021e5600/0x63a04852f4628408 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f462840f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309385.447782:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff97c9021e5600/0x63a04852f4628408 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f462840f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309385.954339:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309386.977510:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788309387.237176:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8c89fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3302:1875178210464512:0@lo:400: 00000100:00100000:0.0:1788309387.237401:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309387.237504:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788309387.237512:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8c89f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875178210464640:0@lo:400: 00000100:00100000:0.0:1788309387.237540:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309387.237605:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210464640 00000100:00100000:0.0:1788309387.237613:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210464640 00000100:00100000:0.0:1788309387.237663:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788309387.237672:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c89f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875178210464640:12345-0@lo:400: 00000100:00100000:0.0:1788309387.237721:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c89f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875178210464640:12345-0@lo:400: Request processed in 51us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309387.237728:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788309387.237764:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff97c8c89f9880 x1875178210464640/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788309387.237778:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8c89f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875178210464640:0@lo:400: 00000100:00100000:2.0:1788309387.237984:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210464512 00000100:00100000:2.0:1788309387.237988:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210464512 00000100:00100000:2.0:1788309387.238128:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788309387.238136:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+12:3302:x1875178210464512:12345-0@lo:400: 00000100:00100000:2.0:1788309387.238176:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+12:3302:x1875178210464512:12345-0@lo:400: Request processed in 41us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309387.238182:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788309387.242234:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8c89fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3302:1875178210464512:0@lo:400: 00010000:00010000:2.0:1788309388.001480:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309389.034610:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788309390.039062:0:6678:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788309390.039067:0:6678:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1788309390.041796:0:6678:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff97c8d6805000 00000020:01000004:3.0:1788309390.041822:0:6678:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788309390.041836:0:6678:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788309390.041854:0:6678:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff97c8e66199b8) 00000020:00000080:3.0:1788309390.041890:0:6678:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00010000:00010000:2.0:1788309390.048375:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1788309390.129619:0:6678:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1788309390.130027:0:6678:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1788309390.202582:0:6678:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788309390.214177:0:6678:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788309390.214215:0:6678:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788309390.214641:0:6678:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788309390.214948:0:6678:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788309390.216065:0:6678:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788309390.216079:0:6678:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788309390.216096:0:6678:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x63a04852f462841d 00000020:01000004:2.0:1788309390.216114:0:6678:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1788309390.216136:0:6678:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.155@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788309390.216139:0:6678:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.155@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788309390.216145:0:6678:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788309390.216150:0:6678:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788309390.216162:0:6678:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff97c8d6bd19b8) 00000020:00000080:2.0:1788309390.216173:0:6678:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1788309390.222167:0:6678:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788309390.222399:0:6678:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788309390.222406:0:6678:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788309390.224936:0:6678:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788309390.224949:0:6678:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788309390.225550:0:6678:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788309390.225558:0:6678:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788309390.232991:0:6678:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788309390.233415:0:6678:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788309390.233425:0:6678:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788309390.247589:0:6678:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788309390.247609:0:6678:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788309390.303262:0:6678:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788309390.303582:0:6678:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788309390.303590:0:6678:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788309390.309070:0:6678:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788309390.309090:0:6678:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788309390.311643:0:6678:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788309390.311659:0:6678:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788309390.323426:0:6678:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788309390.323681:0:6678:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1788309390.323688:0:6678:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788309390.329193:0:6678:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1788309390.329404:0:6678:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788309390.492021:0:6678:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788309390.492264:0:6678:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788309390.492271:0:6678:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1788309390.495234:0:6678:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1788309390.495252:0:6678:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788309390.495923:0:6678:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788309390.495948:0:6678:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1788309390.495954:0:6678:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.155@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788309390.540249:0:6678:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.155@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788309390.540408:0:6678:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.155@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1788309390.540414:0:6678:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788309390.540416:0:6678:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788309390.540417:0:6678:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788309390.540419:0:6678:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788309390.540420:0:6678:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788309390.540421:0:6678:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788309390.540423:0:6678:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788309390.540424:0:6678:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788309390.540426:0:6678:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788309390.540428:0:6678:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788309390.540429:0:6678:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788309390.540433:0:6678:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1788309390.540435:0:6678:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788309390.540437:0:6678:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788309390.540438:0:6678:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788309390.540439:0:6678:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788309390.540440:0:6678:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788309390.540441:0:6678:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788309390.540442:0:6678:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788309390.540443:0:6678:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788309390.540449:0:6678:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788309390.540450:0:6678:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788309390.540451:0:6678:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788309390.540594:0:6678:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788309390.540612:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ec687480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:6678:1875178210464768:0@lo:253: 00000100:00100000:2.0:1788309390.540685:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309390.540845:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d69e8540 going to sleep for 11 seconds 00000100:00100000:0.0:1788309390.546001:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210464768 00000100:00100000:0.0:1788309390.546020:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210464768 00000100:00100000:0.0:1788309390.546564:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788309390.546579:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+12:6678:x1875178210464768:12345-0@lo:253: 20000000:01000000:0.0:1788309390.546615:0:5830:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788309390.546620:0:5830:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1788309390.546641:0:5830:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1788309390.546644:0:5830:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1788309390.548805:0:5830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788309390.549017:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1788309390.549032:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1788309390.549072:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:0.0:1788309390.549079:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1788309390.549102:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:0.0:1788309390.549145:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:0.0:1788309390.549529:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1788309390.549548:0:5830:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.155@tcp 20000000:01000000:0.0:1788309390.549550:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.155@tcp (null) (null) (null) 00000040:00080000:0.0:1788309390.549582:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1788309390.549590:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788309390.549637:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1788309390.549644:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.155@tcp (null) (null) 00000040:00080000:0.0:1788309390.549672:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1788309390.549680:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788309390.549704:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1788309390.549744:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:0.0:1788309390.551778:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1788309390.551805:0:5830:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.155@tcp 20000000:01000000:0.0:1788309390.551807:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.155@tcp (null) (null) (null) 00000040:00080000:0.0:1788309390.551835:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1788309390.551842:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788309390.552018:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1788309390.552026:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.155@tcp (null) (null) 00000040:00080000:0.0:1788309390.552073:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1788309390.552082:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788309390.552111:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:0.0:1788309390.552142:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:0.0:1788309390.552157:0:5830:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788309390.552170:0:5830:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788309390.552173:0:5830:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788309390.552186:0:5830:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788309390.552188:0:5830:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788309390.552379:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788309390.552383:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788309390.563548:0:6693:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1788309390.563649:0:6693:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1788309390.563696:0:6693:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1788309390.564137:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:3.0:1788309390.564181:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:3.0:1788309390.564497:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:3.0:1788309390.564512:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788309390.564515:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788309390.565009:0:6694:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 10 1->4: lustre sys.timeout 20000000:01000000:0.0:1788309390.565052:0:6694:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 10 2->4: lustre sys.timeout 00000040:00080000:0.0:1788309390.565092:0:6694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1788309390.565519:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1788309390.565552:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1788309390.565601:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1788309390.565615:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788309390.565618:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788309390.573959:0:6695:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1788309390.574471:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:3.0:1788309390.574523:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:3.0:1788309390.574616:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:3.0:1788309390.574634:0:5830:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:3.0:1788309390.574637:0:5830:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:3.0:1788309390.574648:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788309390.574671:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97c8c153a400/0x63a04852f462842b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309390.574692:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c8d73ee200/0x63a04852f4628344 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f462833d expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309390.574701:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c8c153ba00/0x63a04852f4628360 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f4628359 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309390.574707:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c8c153b400/0x63a04852f46283d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f46283c9 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309390.574714:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97c8c153a400/0x63a04852f462842b lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309390.574753:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c8c153b400/0x63a04852f46283d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x63a04852f46283c9 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309390.574776:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97c8c153b400/0x63a04852f46283d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x63a04852f46283c9 expref: 12 pid: 5831 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309390.574791:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e667ed80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5830:1875178210464896:0@lo:104: 00000100:00100000:3.0:1788309390.574857:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788309390.574938:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c8c153ba00/0x63a04852f4628360 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x63a04852f4628359 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309390.574946:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97c8c153ba00/0x63a04852f4628360 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x63a04852f4628359 expref: 12 pid: 5830 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309390.574953:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e667f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5830:1875178210465024:0@lo:104: 00000100:00100000:3.0:1788309390.574973:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788309390.575001:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c8d73ee200/0x63a04852f4628344 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x63a04852f462833d expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309390.575009:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97c8d73ee200/0x63a04852f4628344 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x63a04852f462833d expref: 12 pid: 5831 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309390.575017:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e667ea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5830:1875178210465152:0@lo:104: 00000100:00100000:3.0:1788309390.575037:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309390.575048:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8ed046300 going to sleep for 11 seconds 00000100:00100000:0.0:1788309390.575371:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210464896 00000100:00100000:0.0:1788309390.575381:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210464896 00000100:00100000:0.0:1788309390.575418:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210465024 00000100:00100000:0.0:1788309390.575421:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210465024 00000100:00100000:0.0:1788309390.575431:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210465152 00000100:00100000:0.0:1788309390.575434:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210465152 00000100:00100000:0.0:1788309390.575447:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788309390.575456:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e667e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+5:5830:x1875178210464896:12345-0@lo:104: 00010000:00010000:0.0:1788309390.575469:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff97c8e26d9200/0x63a04852f46283c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x63a04852f46283d0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309390.575534:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788309390.575541:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e667e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+5:5830:x1875178210464896:12345-0@lo:104: Request processed in 85us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309390.575547:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788309390.575564:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788309390.575570:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e667c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+4:5830:x1875178210465024:12345-0@lo:104: 00010000:00010000:0.0:1788309390.575577:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8a00/0x63a04852f4628359 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x63a04852f4628360 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309390.575609:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788309390.575622:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e667c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+4:5830:x1875178210465024:12345-0@lo:104: Request processed in 52us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309390.575628:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788309390.575641:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788309390.575647:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e667f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+3:5830:x1875178210465152:12345-0@lo:104: 00010000:00010000:0.0:1788309390.575655:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff97c8e26d9800/0x63a04852f462833d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x63a04852f4628344 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309390.575681:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788309390.575685:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e667f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+3:5830:x1875178210465152:12345-0@lo:104: Request processed in 40us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309390.575691:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1788309390.575706:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788309390.575711:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff97c8e26d9200/0x63a04852f46283c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x63a04852f46283d0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309390.575719:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d9200 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:0.0:1788309390.575723:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff97c8e26d9200/0x63a04852f46283c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x63a04852f46283d0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309390.575731:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff97c8e26d9200/0x63a04852f46283c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x63a04852f46283d0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788309390.575738:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff97c8e26d9200/0x63a04852f46283c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x63a04852f46283d0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788309390.575743:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788309390.575775:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff97c8e26d9200/0x63a04852f46283c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f46283d0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309390.575790:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788309390.575807:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff97c8e26d9200/0x63a04852f46283c9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f46283d0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309390.575813:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff97c8e26d9200/0x63a04852f46283c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f46283d0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309390.575830:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788309390.575833:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8a00/0x63a04852f4628359 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x63a04852f4628360 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309390.575839:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d8a00 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:0.0:1788309390.575842:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8a00/0x63a04852f4628359 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x63a04852f4628360 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309390.575847:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8a00/0x63a04852f4628359 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x63a04852f4628360 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788309390.575853:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8a00/0x63a04852f4628359 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x63a04852f4628360 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788309390.575858:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788309390.575882:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8a00/0x63a04852f4628359 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f4628360 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309390.575887:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788309390.575892:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8a00/0x63a04852f4628359 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f4628360 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309390.575911:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8a00/0x63a04852f4628359 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f4628360 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309390.575928:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788309390.575931:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff97c8e26d9800/0x63a04852f462833d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x63a04852f4628344 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309390.575936:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d9800 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:0.0:1788309390.575938:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff97c8e26d9800/0x63a04852f462833d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x63a04852f4628344 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309390.575944:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff97c8e26d9800/0x63a04852f462833d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x63a04852f4628344 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788309390.575950:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff97c8e26d9800/0x63a04852f462833d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x63a04852f4628344 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788309390.575955:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788309390.575967:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff97c8e26d9800/0x63a04852f462833d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f4628344 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309390.575972:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788309390.575986:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff97c8e26d9800/0x63a04852f462833d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f4628344 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309390.575992:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff97c8e26d9800/0x63a04852f462833d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f4628344 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309390.576005:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309390.576007:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309390.576008:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309390.576016:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788309390.576043:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8c89fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3300:1875178210465280:0@lo:103: 00000100:00100000:0.0:1788309390.576077:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309390.576103:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788309390.576109:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8c89f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3300:1875178210465408:0@lo:103: 00000100:00100000:0.0:1788309390.576125:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309390.576148:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8c89f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3302:1875178210465536:0@lo:103: 00000100:00100000:0.0:1788309390.576164:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309390.576205:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210465280 00000100:00100000:0.0:1788309390.576209:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210465280 00010000:00010000:0.0:1788309390.576378:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c8c153b400/0x63a04852f46283d0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63a04852f46283c9 expref: 13 pid: 5831 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309390.576393:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210465408 00000100:00100000:0.0:1788309390.576396:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210465408 00010000:00010000:0.0:1788309390.576406:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c8c153ba00/0x63a04852f4628360 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63a04852f4628359 expref: 14 pid: 5830 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309390.576416:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210465536 00000100:00100000:0.0:1788309390.576418:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210465536 00010000:00010000:0.0:1788309390.576427:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c8d73ee200/0x63a04852f4628344 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63a04852f462833d expref: 15 pid: 5831 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309390.576438:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788309390.576444:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c89f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+15:3300:x1875178210465280:12345-0@lo:103: 00010000:00010000:0.0:1788309390.576453:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788309390.576458:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c8c153b400/0x63a04852f46283d0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63a04852f46283c9 expref: 15 pid: 5831 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309390.576468:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c8c153b400/0x63a04852f46283d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x63a04852f46283c9 expref: 15 pid: 5831 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309390.576493:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788309390.576523:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c89f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+15:3300:x1875178210465280:12345-0@lo:103: Request processed in 79us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309390.576529:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788309390.576543:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788309390.576549:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c89f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+14:3300:x1875178210465408:12345-0@lo:103: 00010000:00010000:0.0:1788309390.576556:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788309390.576561:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c8c153ba00/0x63a04852f4628360 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63a04852f4628359 expref: 14 pid: 5830 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309390.576569:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c8c153ba00/0x63a04852f4628360 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x63a04852f4628359 expref: 14 pid: 5830 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309390.576579:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788309390.576599:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c89f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+14:3300:x1875178210465408:12345-0@lo:103: Request processed in 51us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309390.576605:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788309390.576616:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788309390.576621:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c89fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+13:3302:x1875178210465536:12345-0@lo:103: 00010000:00010000:0.0:1788309390.576627:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788309390.576631:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c8d73ee200/0x63a04852f4628344 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63a04852f462833d expref: 13 pid: 5831 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309390.576638:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c8d73ee200/0x63a04852f4628344 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x63a04852f462833d expref: 13 pid: 5831 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309390.576650:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97c8c153a400/0x63a04852f462842b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309390.576663:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8c153a400/0x63a04852f462842b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309390.576676:0:5821:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97c8c153a400/0x63a04852f462842b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309390.576684:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97c8c153a400/0x63a04852f462842b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309390.576691:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97c8c153a400/0x63a04852f462842b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309390.576697:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97c8c153a400/0x63a04852f462842b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309390.576702:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8c153a400 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:0.0:1788309390.576707:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97c8c153a400/0x63a04852f462842b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309390.576713:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97c8c153a400/0x63a04852f462842b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309390.576721:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97c8c153a400/0x63a04852f462842b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309390.576729:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788309390.576753:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c89fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+13:3302:x1875178210465536:12345-0@lo:103: Request processed in 132us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309390.576759:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788309390.576794:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8c89f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3300:1875178210465408:0@lo:103: 00000100:00100000:0.0:1788309390.576808:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8c89fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3300:1875178210465280:0@lo:103: 00000100:00100000:0.0:1788309390.576827:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8c89f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3302:1875178210465536:0@lo:103: 00010000:00010000:3.0:1788309390.577046:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c8c153b400/0x63a04852f46283d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x63a04852f46283c9 expref: 12 pid: 5831 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309390.577071:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e667ed80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5830:1875178210464896:0@lo:104: 00010000:00010000:3.0:1788309390.577082:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c8c153ba00/0x63a04852f4628360 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x63a04852f4628359 expref: 11 pid: 5830 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309390.577100:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e667f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5830:1875178210465024:0@lo:104: 00010000:00010000:3.0:1788309390.577109:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c8d73ee200/0x63a04852f4628344 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x63a04852f462833d expref: 10 pid: 5831 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309390.577116:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e667ea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5830:1875178210465152:0@lo:104: 00010000:00010000:3.0:1788309390.577132:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97c8c153a400/0x63a04852f462842b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309390.577139:0:5830:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97c8c153a400/0x63a04852f462842b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309390.577145:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97c8c153a400/0x63a04852f462842b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309390.577150:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c8c153a400/0x63a04852f462842b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788309390.577163:0:5830:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788309390.660811:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+9:6678:x1875178210464768:12345-0@lo:253: Request processed in 114225us (120114us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309390.660827:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788309390.661048:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ec687480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:6678:1875178210464768:0@lo:253: 10000000:01000000:3.0:1788309390.661065:0:6678:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788309390.661069:0:6678:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788309390.661071:0:6678:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788309390.661073:0:6678:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788309390.661074:0:6678:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1788309390.661075:0:6678:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788309390.661077:0:6678:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788309390.661078:0:6678:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788309390.661080:0:6678:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788309390.661081:0:6678:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788309390.661083:0:6678:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788309390.661118:0:6678:0:(tgt_mount.c:101:server_register_mount()) register mount ffff97c8d6805000 from lustre-OST0000 10000000:01000000:3.0:1788309390.661145:0:6678:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788309390.661147:0:6678:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788309390.661154:0:6678:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff97c8e661b370 local copy 10000000:01000000:3.0:1788309390.661159:0:6678:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788309390.661200:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8c153a400/0x63a04852f4628432 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309390.661211:0:6678:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.155@tcp lock: ffff97c8c153a400/0x63a04852f4628432 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309390.661386:0:6678:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff97c8c153a400/0x63a04852f4628432 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309390.661413:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e667ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:6678:1875178210465664:0@lo:101: 00000100:00100000:3.0:1788309390.661524:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309390.661606:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8ed046900 going to sleep for 11 seconds 00000100:00100000:2.0:1788309390.663203:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210465664 00000100:00100000:2.0:1788309390.663216:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210465664 00000100:00100000:3.0:1788309390.663375:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788309390.663387:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+9:6678:x1875178210465664:12345-0@lo:101: 00010000:00010000:3.0:1788309390.663403:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309390.663425:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c8c153ba00/0x63a04852f4628439 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x63a04852f4628432 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309390.663465:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8c153ba00/0x63a04852f4628439 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63a04852f4628432 expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309390.663477:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c8c153ba00/0x63a04852f4628439 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f4628432 expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309390.663486:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8c153ba00, rc 0) 00000100:00100000:3.0:1788309390.663555:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+10:6678:x1875178210465664:12345-0@lo:101: Request processed in 171us (2031us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309390.663576:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788309390.663624:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e667ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:6678:1875178210465664:0@lo:101: 00010000:00010000:2.0:1788309390.663640:0:6678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff97c8c153a400/0x63a04852f4628432 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x63a04852f4628439 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309390.663649:0:6678:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff97c8c153a400/0x63a04852f4628432 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x63a04852f4628439 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309390.663772:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ec686a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:6678:1875178210465792:0@lo:501: 00000100:00100000:2.0:1788309390.663808:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309390.663848:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d69e8840 going to sleep for 11 seconds 00000100:00100000:1.0:1788309390.663859:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210465792 00000100:00100000:1.0:1788309390.663873:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210465792 00000100:00100000:1.0:1788309390.663910:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788309390.663918:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+10:6678:x1875178210465792:12345-0@lo:501: 00000100:00100000:1.0:1788309390.664142:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+10:6678:x1875178210465792:12345-0@lo:501: Request processed in 224us (332us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788309390.664157:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788309390.664230:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ec686a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:6678:1875178210465792:0@lo:501: 10000000:01000000:2.0:1788309390.664244:0:6678:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.155@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788309390.664271:0:6678:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.155@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788309390.664315:0:6678:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8c153a400/0x63a04852f4628432 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x63a04852f4628439 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309390.664953:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8c153a400/0x63a04852f4628432 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x63a04852f4628439 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309390.664968:0:6678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.155@tcp lock: ffff97c8c153a400/0x63a04852f4628432 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x63a04852f4628439 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309390.665067:0:6678:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788309390.665098:0:6678:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff97c8d6805000 00010000:00010000:0.0:1788309390.665103:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:3.0:1788309390.665104:0:6678:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788309390.665110:0:6678:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff97c8e661b370 00010000:00010000:0.0:1788309390.665110:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff97c8c153a400/0x63a04852f4628432 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x63a04852f4628439 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788309390.665112:0:6678:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788309390.665116:0:6678:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff97c8e661b370 from 1 00010000:00010000:0.0:1788309390.665117:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8c153a400 already unused, calling callback (ffffffffc1de7c20) 10000000:01000000:3.0:1788309390.665118:0:6678:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 10000000:00010000:0.0:1788309390.665121:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff97c8c153a400/0x63a04852f4628432 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x63a04852f4628439 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309390.665130:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff97c8c153a400/0x63a04852f4628432 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x63a04852f4628439 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788309390.665137:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff97c8c153a400/0x63a04852f4628432 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x63a04852f4628439 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788309390.665143:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788309390.665151:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8c153b400/0x63a04852f4628440 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309390.665159:0:6678:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff97c8c153b400/0x63a04852f4628440 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309390.665168:0:6678:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff97c8c153b400/0x63a04852f4628440 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309390.665187:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e667f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:6678:1875178210465920:0@lo:101: 00000100:00100000:3.0:1788309390.665249:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309390.665314:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8ed046900 going to sleep for 11 seconds 00000100:00100000:1.0:1788309390.665424:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210465920 00000100:00100000:1.0:1788309390.665431:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210465920 00000100:00100000:1.0:1788309390.665538:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788309390.665548:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+10:6678:x1875178210465920:12345-0@lo:101: 00010000:00010000:1.0:1788309390.665558:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788309390.665570:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c9021e5c00/0x63a04852f4628447 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x63a04852f4628440 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309390.665590:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c9021e5c00/0x63a04852f4628447 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63a04852f4628440 expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309390.665601:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c9021e5c00/0x63a04852f4628447 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f4628440 expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309390.665609:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c9021e5c00, rc 0) 00000100:00100000:1.0:1788309390.665645:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+11:6678:x1875178210465920:12345-0@lo:101: Request processed in 99us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309390.665651:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788309390.665735:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e667f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:6678:1875178210465920:0@lo:101: 00010000:00010000:2.0:1788309390.665747:0:6678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff97c8c153b400/0x63a04852f4628440 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4628447 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309390.665756:0:6678:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff97c8c153b400/0x63a04852f4628440 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x63a04852f4628447 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788309390.665773:0:6678:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788309390.665791:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8c153b400/0x63a04852f4628440 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4628447 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309390.665798:0:6678:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff97c8c153b400/0x63a04852f4628440 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4628447 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788309390.665805:0:6678:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788309390.665808:0:6678:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788309390.665812:0:6678:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1788309390.665814:0:6678:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788309390.665817:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff97c8c153a400/0x63a04852f4628432 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x63a04852f4628439 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309390.665823:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788309390.665825:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8000/0x63a04852f462844e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309390.665831:0:6678:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8000/0x63a04852f462844e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309390.665840:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff97c8c153a400/0x63a04852f4628432 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x4809400000020 nid: local remote: 0x63a04852f4628439 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309390.665848:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff97c8c153a400/0x63a04852f4628432 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x63a04852f4628439 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309390.665849:0:6678:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8000/0x63a04852f462844e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309390.665861:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ec686a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:6678:1875178210466176:0@lo:101: 00010000:00010000:0.0:1788309390.665875:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309390.665877:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309390.665884:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788309390.665895:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8c89f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3303:1875178210466048:0@lo:103: 00000100:00100000:2.0:1788309390.665899:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309390.665916:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d69e8840 going to sleep for 11 seconds 00000100:00100000:0.0:1788309390.665923:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309390.665949:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210466048 00000100:00100000:2.0:1788309390.665953:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210466048 00000100:00100000:0.0:1788309390.665953:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210466176 00000100:00100000:0.0:1788309390.665955:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210466176 00000100:00100000:0.0:1788309390.665975:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788309390.665982:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+12:6678:x1875178210466176:12345-0@lo:101: 00010000:00010000:0.0:1788309390.665988:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788309390.665997:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c8d73efe00/0x63a04852f4628455 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x63a04852f462844e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309390.666009:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8d73efe00/0x63a04852f4628455 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63a04852f462844e expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309390.666017:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c8d73efe00/0x63a04852f4628455 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f462844e expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309390.666023:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8d73efe00, rc 0) 00000100:00100000:0.0:1788309390.666049:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+13:6678:x1875178210466176:12345-0@lo:101: Request processed in 68us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309390.666055:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788309390.666063:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788309390.666070:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c89fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+12:3303:x1875178210466048:12345-0@lo:103: 00010000:00010000:2.0:1788309390.666079:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788309390.666091:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c8c153ba00/0x63a04852f4628439 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x63a04852f4628432 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309390.666102:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788309390.666130:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c89fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+11:3303:x1875178210466048:12345-0@lo:103: Request processed in 60us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309390.666137:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788309390.666164:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ec686a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:6678:1875178210466176:0@lo:101: 00010000:00010000:2.0:1788309390.666173:0:6678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8000/0x63a04852f462844e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4628455 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309390.666181:0:6678:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8000/0x63a04852f462844e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x63a04852f4628455 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309390.666263:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8c89f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3303:1875178210466048:0@lo:103: 00000100:00100000:3.0:1788309390.668661:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e667ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:6678:1875178210466304:0@lo:501: 00000100:00100000:3.0:1788309390.668744:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309390.668792:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8ed046300 going to sleep for 11 seconds 00000100:00100000:0.0:1788309390.668969:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210466304 00000100:00100000:0.0:1788309390.668976:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210466304 00000100:00100000:0.0:1788309390.669024:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788309390.669033:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+11:6678:x1875178210466304:12345-0@lo:501: 00000100:00100000:0.0:1788309390.669829:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+11:6678:x1875178210466304:12345-0@lo:501: Request processed in 794us (1082us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309390.669845:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788309390.669926:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e667ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:6678:1875178210466304:0@lo:501: 00000100:00100000:2.0:1788309390.669969:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ec686a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:6678:1875178210466432:0@lo:503: 00000100:00100000:2.0:1788309390.670025:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309390.670055:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d69e8840 going to sleep for 11 seconds 00000100:00100000:3.0:1788309390.670169:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210466432 00000100:00100000:3.0:1788309390.670174:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210466432 00000100:00100000:3.0:1788309390.670223:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788309390.670231:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+11:6678:x1875178210466432:12345-0@lo:503: 00000100:00100000:3.0:1788309390.670412:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+11:6678:x1875178210466432:12345-0@lo:503: Request processed in 181us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309390.670425:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788309390.670477:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ec686a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:6678:1875178210466432:0@lo:503: 00000040:00080000:3.0:1788309390.670748:0:6678:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788309390.670806:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e667d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:6678:1875178210466560:0@lo:502: 00000100:00100000:3.0:1788309390.670840:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309390.670880:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8ed046300 going to sleep for 11 seconds 00000100:00100000:0.0:1788309390.670893:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210466560 00000100:00100000:0.0:1788309390.670897:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210466560 00000100:00100000:0.0:1788309390.670936:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788309390.670944:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+11:6678:x1875178210466560:12345-0@lo:502: 00000100:00100000:0.0:1788309390.671071:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+11:6678:x1875178210466560:12345-0@lo:502: Request processed in 128us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309390.671078:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788309390.671117:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e667d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:6678:1875178210466560:0@lo:502: 00000040:00080000:0.0:1788309390.672747:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788309390.672816:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1788309390.673053:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1788309390.673110:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1788309390.673142:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1788309390.673173:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1788309390.673226:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8c89f9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:6678:1875178210466688:0@lo:502: 00000100:00100000:0.0:1788309390.673909:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309390.673964:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d69c2900 going to sleep for 11 seconds 00000100:00100000:3.0:1788309390.674167:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210466688 00000100:00100000:3.0:1788309390.674175:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210466688 00000100:00100000:3.0:1788309390.674234:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788309390.674244:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6a6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+11:6678:x1875178210466688:12345-0@lo:502: 00000100:00100000:3.0:1788309390.674831:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6a6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+11:6678:x1875178210466688:12345-0@lo:502: Request processed in 586us (1483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309390.674839:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788309390.675474:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8c89f9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:6678:1875178210466688:0@lo:502: 00000040:00080000:1.0:1788309390.675616:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1788309390.675630:0:6678:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:3.0:1788309390.676249:0:6697:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788309390.676257:0:6697:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1788309390.676264:0:6697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788309390.676266:0:6697:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788309390.676271:0:6697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788309390.676511:0:6697:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff97c8e6618000) 00000020:00000080:3.0:1788309390.676532:0:6697:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788309390.676540:0:6697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788309390.676612:0:6697:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97c8d6805000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788309390.676618:0:6697:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788309390.676624:0:6697:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x63a04852f4628463 00010000:00010000:3.0:1788309390.683805:0:6697:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:3.0:1788309390.684568:0:6697:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1788309390.687787:0:6697:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1788309390.688385:0:6697:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1788309390.702771:0:6697:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1788309390.704033:0:6697:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1788309390.718270:0:6697:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788309390.718508:0:6697:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788309390.718516:0:6697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788309390.718518:0:6697:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788309390.718522:0:6697:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788309390.718526:0:6697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788309390.718528:0:6697:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788309390.718531:0:6697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788309390.718533:0:6697:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788309390.718587:0:6697:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788309390.718590:0:6697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788309390.718601:0:6697:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788309390.718605:0:6697:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788309390.718905:0:6678:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1788309390.718933:0:6678:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788309390.718958:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8000/0x63a04852f462844e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4628455 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309390.718980:0:6678:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8000/0x63a04852f462844e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4628455 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788309390.719000:0:6678:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97c8d6805000 from 1 10000000:01000000:1.0:1788309390.719003:0:6678:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788309390.719040:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c9021e4600/0x63a04852f462846a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309390.719048:0:6678:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff97c9021e4600/0x63a04852f462846a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309390.719059:0:6678:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff97c9021e4600/0x63a04852f462846a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309390.719086:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8f4ce1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:6678:1875178210466816:0@lo:101: 00000100:00100000:1.0:1788309390.719158:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309390.719228:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c948fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788309390.719489:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210466816 00000100:00100000:3.0:1788309390.719499:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210466816 00000100:00100000:3.0:1788309390.719552:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788309390.719562:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6a6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+11:6678:x1875178210466816:12345-0@lo:101: 00010000:00010000:3.0:1788309390.719574:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309390.719587:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c8c153a200/0x63a04852f4628471 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x63a04852f462846a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309390.719608:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8c153a200/0x63a04852f4628471 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63a04852f462846a expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309390.719618:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c8c153a200/0x63a04852f4628471 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f462846a expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309390.719627:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8c153a200, rc 0) 00000100:00100000:1.0:1788309390.719826:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8f4ce1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:6678:1875178210466816:0@lo:101: 00010000:00010000:1.0:1788309390.719840:0:6678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff97c9021e4600/0x63a04852f462846a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4628471 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309390.719849:0:6678:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff97c9021e4600/0x63a04852f462846a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x63a04852f4628471 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309390.719952:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8f4ce1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:6678:1875178210466944:0@lo:501: 00000100:00100000:1.0:1788309390.719993:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309390.720012:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c948fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788309390.720099:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6a6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+12:6678:x1875178210466816:12345-0@lo:101: Request processed in 105us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309390.720107:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788309390.720133:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210466944 00000100:00100000:3.0:1788309390.720137:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210466944 00000100:00100000:3.0:1788309390.720166:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788309390.720172:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6a6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+12:6678:x1875178210466944:12345-0@lo:501: 00000100:00100000:3.0:1788309390.720623:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6a6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+12:6678:x1875178210466944:12345-0@lo:501: Request processed in 450us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309390.720630:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788309390.721106:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8f4ce1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:6678:1875178210466944:0@lo:501: 00000100:00100000:1.0:1788309390.721137:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8f4ce1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:6678:1875178210467072:0@lo:503: 00000100:00100000:1.0:1788309390.721184:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309390.721221:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c948fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788309390.721435:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210467072 00000100:00100000:3.0:1788309390.721441:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210467072 00000100:00100000:3.0:1788309390.721481:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788309390.721488:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6a6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+12:6678:x1875178210467072:12345-0@lo:503: 00000100:00100000:3.0:1788309390.721918:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6a6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+12:6678:x1875178210467072:12345-0@lo:503: Request processed in 430us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309390.721926:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788309390.722011:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8f4ce1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:6678:1875178210467072:0@lo:503: 00000040:00080000:1.0:1788309390.722348:0:6678:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788309390.722419:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8f4ce1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:6678:1875178210467200:0@lo:502: 00000100:00100000:1.0:1788309390.722471:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309390.722494:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c948fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788309390.722831:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210467200 00000100:00100000:3.0:1788309390.722836:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210467200 00000100:00100000:3.0:1788309390.722883:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788309390.722890:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6a6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+12:6678:x1875178210467200:12345-0@lo:502: 00000100:00100000:3.0:1788309390.723058:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6a6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+12:6678:x1875178210467200:12345-0@lo:502: Request processed in 168us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309390.723066:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788309390.723108:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8f4ce1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:6678:1875178210467200:0@lo:502: 00000040:00080000:3.0:1788309390.723425:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1788309390.723680:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1788309390.723707:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e667c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:6678:1875178210467328:0@lo:502: 00000100:00100000:3.0:1788309390.723745:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309390.723770:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210467328 00000100:00100000:3.0:1788309390.723775:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210467328 00000100:00100000:3.0:1788309390.723794:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788309390.723800:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6a6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+12:6678:x1875178210467328:12345-0@lo:502: 00000100:00100000:3.0:1788309390.723933:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6a6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+12:6678:x1875178210467328:12345-0@lo:502: Request processed in 132us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309390.723939:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788309390.723988:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d6aee0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788309390.724003:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e667c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:6678:1875178210467328:0@lo:502: 00000040:00080000:3.0:1788309390.724078:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1788309390.724087:0:6678:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1788309390.724980:0:6700:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788309390.724992:0:6700:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788309390.724994:0:6700:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788309390.725001:0:6700:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97c8d6805000 00000020:00000080:0.0:1788309390.725004:0:6700:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788309390.725025:0:6700:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788309390.725029:0:6700:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788309390.725030:0:6700:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788309390.725033:0:6700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1788309390.725067:0:6678:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788309390.725088:0:6678:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788309390.725104:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c9021e4600/0x63a04852f462846a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4628471 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309390.725116:0:6678:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff97c9021e4600/0x63a04852f462846a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4628471 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788309390.725180:0:6678:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788309390.725184:0:6678:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff97c8d6805000 10000000:01000000:0.0:1788309390.725188:0:6678:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff97c8d6805000 10000000:01000000:0.0:1788309390.725192:0:6678:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788309390.725198:0:6678:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97c8d6805000 from 1 10000000:01000000:0.0:1788309390.725200:0:6678:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788309390.725758:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8d73ee200/0x63a04852f4628478 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309390.725770:0:6678:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff97c8d73ee200/0x63a04852f4628478 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309390.725780:0:6678:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff97c8d73ee200/0x63a04852f4628478 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309390.725811:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8c89f9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:6678:1875178210467456:0@lo:101: 00000100:00100000:0.0:1788309390.725875:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309390.725905:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d69c2900 going to sleep for 11 seconds 00000100:00100000:3.0:1788309390.726064:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210467456 00000100:00100000:3.0:1788309390.726071:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210467456 00000100:00100000:3.0:1788309390.726109:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788309390.726118:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6a6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+12:6678:x1875178210467456:12345-0@lo:101: 00010000:00010000:3.0:1788309390.726130:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309390.726142:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c8c153bc00/0x63a04852f462847f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x63a04852f4628478 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309390.726165:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8c153bc00/0x63a04852f462847f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63a04852f4628478 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309390.726177:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c8c153bc00/0x63a04852f462847f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f4628478 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309390.726187:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8c153bc00, rc 0) 00000100:00100000:3.0:1788309390.726558:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6a6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+13:6678:x1875178210467456:12345-0@lo:101: Request processed in 439us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309390.726565:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788309390.734619:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8c89f9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:6678:1875178210467456:0@lo:101: 00010000:00010000:0.0:1788309390.734650:0:6678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff97c8d73ee200/0x63a04852f4628478 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f462847f expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309390.735043:0:6678:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff97c8d73ee200/0x63a04852f4628478 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x63a04852f462847f expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309390.735180:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8c89f9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:6678:1875178210467584:0@lo:501: 00000100:00100000:0.0:1788309390.735615:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309390.735775:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d69c2900 going to sleep for 11 seconds 00000100:00100000:1.0:1788309390.746935:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210467584 00000100:00100000:1.0:1788309390.746952:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210467584 00000100:00100000:1.0:1788309390.747033:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788309390.747044:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6a6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+13:6678:x1875178210467584:12345-0@lo:501: 00000100:00100000:1.0:1788309390.747612:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6a6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+13:6678:x1875178210467584:12345-0@lo:501: Request processed in 568us (11996us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309390.747621:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788309390.747883:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8c89f9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:6678:1875178210467584:0@lo:501: 00000100:00100000:0.0:1788309390.747936:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8c89f9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:6678:1875178210467712:0@lo:503: 00000100:00100000:0.0:1788309390.747997:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309390.748036:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d69c2900 going to sleep for 11 seconds 00000100:00100000:3.0:1788309390.748086:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210467712 00000100:00100000:3.0:1788309390.748092:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210467712 00000100:00100000:3.0:1788309390.748121:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788309390.748128:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6a6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+13:6678:x1875178210467712:12345-0@lo:503: 00000100:00100000:3.0:1788309390.748346:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6a6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+13:6678:x1875178210467712:12345-0@lo:503: Request processed in 218us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309390.748353:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788309390.748609:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8c89f9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:6678:1875178210467712:0@lo:503: 00000040:00080000:0.0:1788309390.748907:0:6678:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788309390.748982:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8c89f9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:6678:1875178210467840:0@lo:502: 00000100:00100000:0.0:1788309390.749022:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309390.749059:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d69c2900 going to sleep for 11 seconds 00000100:00100000:3.0:1788309390.749228:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210467840 00000100:00100000:3.0:1788309390.749233:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210467840 00000100:00100000:3.0:1788309390.749270:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788309390.749304:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6a6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+13:6678:x1875178210467840:12345-0@lo:502: 00000100:00100000:3.0:1788309390.749488:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6a6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+13:6678:x1875178210467840:12345-0@lo:502: Request processed in 211us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309390.749496:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788309390.749828:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8c89f9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:6678:1875178210467840:0@lo:502: 00000040:00080000:0.0:1788309390.750128:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788309390.750183:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788309390.750238:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788309390.750321:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788309390.750359:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788309390.750407:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788309390.750442:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788309390.750837:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788309390.750902:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788309390.750938:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788309390.751075:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788309390.751144:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788309390.751179:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788309390.751211:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788309390.751419:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1788309390.751558:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788309390.751597:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788309390.751656:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788309390.751769:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788309390.751805:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788309390.751853:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788309390.751903:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788309390.751938:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788309390.752420:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788309390.752531:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1788309390.752567:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1788309390.752614:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1788309390.752650:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:0.0:1788309390.752764:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8c89f9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:6678:1875178210467968:0@lo:502: 00000100:00100000:0.0:1788309390.752840:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309390.752940:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d69c2900 going to sleep for 11 seconds 00000100:00100000:3.0:1788309390.753054:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210467968 00000100:00100000:3.0:1788309390.753063:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210467968 00000100:00100000:3.0:1788309390.753146:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788309390.753156:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6a6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+13:6678:x1875178210467968:12345-0@lo:502: 00000100:00100000:3.0:1788309390.753435:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6a6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+13:6678:x1875178210467968:12345-0@lo:502: Request processed in 279us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309390.753443:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788309390.753876:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8c89f9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:6678:1875178210467968:0@lo:502: 00000040:00080000:1.0:1788309390.753963:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1788309390.753987:0:6678:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1788309390.755168:0:6702:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788309390.755195:0:6702:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff97c8eff4cd28) 00000020:00000080:1.0:1788309390.755224:0:6702:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:1.0:1788309390.755338:0:6702:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97c8d6805000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788309390.755342:0:6702:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97c8d6805000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788309390.755345:0:6702:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97c8d6805000 3 00010000:00080000:1.0:1788309390.755373:0:6702:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97c8d123d800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.155@tcp at head 00010000:00010000:1.0:1788309390.759037:0:6702:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:1.0:1788309390.759338:0:6702:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788309390.759377:0:6702:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788309390.759410:0:6702:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x63a04852f462848d 00000100:00080000:1.0:1788309390.759421:0:6702:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788309390.759426:0:6702:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff97c8d123d800 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:1.0:1788309390.759464:0:6702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97c8f4ce1f80 x1875178210468096/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788309390.759498:0:6702:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788309390.759653:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8f4ce1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3299:1875178210468096:0@lo:38: 00000100:00100000:0.0:1788309390.759738:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309390.759924:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210468096 00000100:00100000:1.0:1788309390.759932:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210468096 00000100:00100000:1.0:1788309390.759968:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788309390.759977:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c89fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3299:x1875178210468096:12345-0@lo:38: 00010000:00080000:1.0:1788309390.760005:0:5837:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 153 last 0 00000020:00000080:1.0:1788309390.760036:0:5837:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x63a04852f4628494 00000004:00100000:1.0:1788309390.760051:0:5837:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788309390.760087:0:5837:0:(import.c:65:import_set_state_nolock()) ffff97c8ffc73800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788309390.760141:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c89fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1875178210468096:12345-0@lo:38: Request processed in 163us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309390.760149:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788309390.760427:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff97c8f4ce1f80 x1875178210468096/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788309400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788309390.760438:0:3299:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788309390.760446:0:3299:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1788309390.760452:0:3299:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788309390.760456:0:3299:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788309390.760459:0:3299:0:(import.c:65:import_set_state_nolock()) ffff97c8d123d800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788309390.760465:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8f4ce1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3299:1875178210468096:0@lo:38: 00000100:00100000:1.0:1788309390.760691:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788309390.760701:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e667c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875178210468224:0@lo:400: 00000100:00100000:1.0:1788309390.760736:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309390.760858:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210468224 00000100:00100000:3.0:1788309390.760874:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210468224 00000100:00100000:3.0:1788309390.760912:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788309390.760921:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f4ce0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875178210468224:12345-0@lo:400: 00000100:00100000:3.0:1788309390.760967:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f4ce0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875178210468224:12345-0@lo:400: Request processed in 48us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309390.760973:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788309390.761007:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff97c8e667c700 x1875178210468224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309406 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788309390.761017:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e667c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875178210468224:0@lo:400: 00000040:00080000:3.0:1788309390.761917:0:6702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:1.0:1788309390.762028:0:6678:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1788309390.762053:0:6678:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788309390.762074:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8d73ee200/0x63a04852f4628478 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f462847f expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309390.762086:0:6678:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff97c8d73ee200/0x63a04852f4628478 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f462847f expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788309390.762141:0:6678:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788309390.762144:0:6678:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788309390.762145:0:6678:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788309390.762146:0:6678:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788309390.762147:0:6678:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788309390.762149:0:6678:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788309390.762150:0:6678:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788309390.762152:0:6678:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788309390.762153:0:6678:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788309390.762155:0:6678:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788309390.762157:0:6678:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788309390.762161:0:6678:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1788309390.762163:0:6678:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788309390.762164:0:6678:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788309390.762165:0:6678:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788309390.762167:0:6678:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788309390.762168:0:6678:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788309390.762169:0:6678:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788309390.762170:0:6678:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788309390.762171:0:6678:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788309390.762172:0:6678:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788309390.762173:0:6678:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788309390.762174:0:6678:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788309390.762192:0:6678:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788309390.762206:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8f4ce3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:6678:1875178210468352:0@lo:253: 00000100:00100000:1.0:1788309390.762266:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309390.766963:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c948f600 going to sleep for 11 seconds 00000100:00100000:2.0:1788309390.768692:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210468352 00000100:00100000:2.0:1788309390.768711:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210468352 00000100:00100000:2.0:1788309390.768799:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788309390.768811:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6a6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+13:6678:x1875178210468352:12345-0@lo:253: 20000000:01000000:2.0:1788309390.768845:0:5831:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788309390.768888:0:5831:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788309390.824803:0:5831:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788309390.824816:0:5831:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788309390.826198:0:5853:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788309390.826206:0:5853:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788309390.826228:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97c8d73eea00/0x63a04852f462849b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309390.826246:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c8e26d9c00/0x63a04852f46283fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f46283f3 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309390.826255:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97c8d73eea00/0x63a04852f462849b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309390.826326:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c8e26d9c00/0x63a04852f46283fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x63a04852f46283f3 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309390.826341:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97c8e26d9c00/0x63a04852f46283fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x63a04852f46283f3 expref: 13 pid: 5831 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309390.826426:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8c89fa680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5853:1875178210468480:0@lo:104: 00000100:00100000:0.0:1788309390.826496:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309390.826615:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d69c2a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788309390.826636:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210468480 00000100:00100000:0.0:1788309390.826654:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210468480 00000100:00100000:0.0:1788309390.826695:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788309390.826703:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c89fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+3:5853:x1875178210468480:12345-0@lo:104: 00010000:00010000:0.0:1788309390.826715:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff97c8c153a000/0x63a04852f46283f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x63a04852f46283fa expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309390.826762:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788309390.826769:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c89fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+3:5853:x1875178210468480:12345-0@lo:104: Request processed in 65us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309390.826777:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1788309390.826808:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788309390.826814:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff97c8c153a000/0x63a04852f46283f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x63a04852f46283fa expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309390.826821:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8c153a000 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:0.0:1788309390.826825:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff97c8c153a000/0x63a04852f46283f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x63a04852f46283fa expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309390.826833:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff97c8c153a000/0x63a04852f46283f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x63a04852f46283fa expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788309390.826840:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff97c8c153a000/0x63a04852f46283f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x63a04852f46283fa expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788309390.826846:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788309390.828153:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff97c8c153a000/0x63a04852f46283f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f46283fa expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309390.828166:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788309390.828232:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1788309390.829080:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff97c8c153a000/0x63a04852f46283f3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f46283fa expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309390.829103:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff97c8c153a000/0x63a04852f46283f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f46283fa expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309390.829122:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309390.829124:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309390.829126:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788309390.829158:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8c89fa680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5853:1875178210468480:0@lo:104: 00010000:00010000:0.0:1788309390.829184:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97c8d73eea00/0x63a04852f462849b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309390.829652:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8c89f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3300:1875178210468608:0@lo:103: 00000100:00100000:2.0:1788309390.829712:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309390.829794:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210468608 00000100:00100000:1.0:1788309390.829802:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210468608 00010000:00010000:1.0:1788309390.829832:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c8e26d9c00/0x63a04852f46283fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63a04852f46283f3 expref: 14 pid: 5831 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309390.829878:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788309390.829902:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6b2b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+14:3300:x1875178210468608:12345-0@lo:103: 00010000:00010000:1.0:1788309390.829925:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788309390.829932:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c8e26d9c00/0x63a04852f46283fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63a04852f46283f3 expref: 14 pid: 5831 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309390.829944:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c8e26d9c00/0x63a04852f46283fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x63a04852f46283f3 expref: 14 pid: 5831 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309390.829960:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c8e26d9c00/0x63a04852f46283fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x63a04852f46283f3 expref: 14 pid: 5831 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309390.830127:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97c8d73eea00/0x63a04852f462849b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309390.830136:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8d73eea00/0x63a04852f462849b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788309390.830149:0:5823:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003944353s 00010000:00010000:1.0:1788309390.830155:0:5823:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97c8d73eea00/0x63a04852f462849b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309390.830162:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97c8d73eea00/0x63a04852f462849b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309390.830168:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97c8d73eea00/0x63a04852f462849b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309390.830175:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97c8d73eea00/0x63a04852f462849b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309390.830181:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8d73eea00 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:1.0:1788309390.830185:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97c8d73eea00/0x63a04852f462849b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309390.830199:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97c8d73eea00/0x63a04852f462849b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309390.830219:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97c8d73eea00/0x63a04852f462849b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309390.830228:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788309390.830300:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6b2b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+13:3300:x1875178210468608:12345-0@lo:103: Request processed in 388us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309390.830308:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788309390.830355:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8c89f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3300:1875178210468608:0@lo:103: 00010000:00010000:0.0:1788309390.830473:0:5853:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97c8d73eea00/0x63a04852f462849b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309390.830481:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97c8d73eea00/0x63a04852f462849b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309390.830488:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c8d73eea00/0x63a04852f462849b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309390.835908:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6a6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+12:6678:x1875178210468352:12345-0@lo:253: Request processed in 67089us (73631us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309390.835924:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788309390.836128:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8f4ce3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:6678:1875178210468352:0@lo:253: 10000000:01000000:1.0:1788309390.836143:0:6678:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788309390.836147:0:6678:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788309390.836149:0:6678:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788309390.836150:0:6678:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788309390.836151:0:6678:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788309390.836152:0:6678:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788309390.836154:0:6678:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788309390.836155:0:6678:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788309390.836157:0:6678:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788309390.836159:0:6678:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788309390.836160:0:6678:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788309390.836162:0:6678:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788309390.836175:0:6678:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788309390.846120:0:6678:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788309390.846741:0:6678:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788309390.846956:0:6678:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788309390.847124:0:6678:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788309390.849638:0:6678:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788309390.849987:0:6678:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788309390.851659:0:6678:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:2.0:1788309391.073671:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1788309391.187324:0:6678:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788309391.187332:0:6678:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788309391.187370:0:6678:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788309391.187429:0:6678:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.155@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788309391.187442:0:6678:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788309391.187538:0:6678:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1788309392.098185:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309393.120544:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309394.149968:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309395.171414:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788309395.427876:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788309395.427895:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97c8e07b1000 from 21 10000000:01000000:3.0:1788309395.427902:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788309395.427962:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8c153a400/0x63a04852f46284a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309395.427977:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff97c8c153a400/0x63a04852f46284a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309395.427991:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff97c8c153a400/0x63a04852f46284a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309395.428023:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e667c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210468736:0@lo:101: 00000100:00100000:3.0:1788309395.428116:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309395.428188:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c948f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788309395.429306:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210468736 00000100:00100000:0.0:1788309395.429321:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210468736 00000100:00100000:0.0:1788309395.429403:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788309395.429415:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6a6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+12:5834:x1875178210468736:12345-0@lo:101: 00010000:00010000:0.0:1788309395.429439:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788309395.429456:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c8d73eee00/0x63a04852f46284a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x63a04852f46284a2 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309395.429487:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8d73eee00/0x63a04852f46284a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63a04852f46284a2 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309395.429509:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c8d73eee00/0x63a04852f46284a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f46284a2 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309395.429521:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8d73eee00, rc 0) 00000100:00100000:0.0:1788309395.429903:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6a6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+13:5834:x1875178210468736:12345-0@lo:101: Request processed in 488us (1785us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309395.429913:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788309395.430067:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e667c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210468736:0@lo:101: 00010000:00010000:3.0:1788309395.430090:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff97c8c153a400/0x63a04852f46284a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f46284a9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309395.430102:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff97c8c153a400/0x63a04852f46284a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x63a04852f46284a9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309395.430190:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e667c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210468864:0@lo:501: 00000100:00100000:3.0:1788309395.430227:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309395.430270:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c948f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788309395.430369:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210468864 00000100:00100000:2.0:1788309395.430375:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210468864 00000100:00100000:2.0:1788309395.430401:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788309395.430415:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6a6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+13:5834:x1875178210468864:12345-0@lo:501: 00000100:00100000:2.0:1788309395.431058:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6a6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+13:5834:x1875178210468864:12345-0@lo:501: Request processed in 644us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309395.431066:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788309395.431304:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e667c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210468864:0@lo:501: 00000100:00100000:0.0:1788309395.431344:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8c89fa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210468992:0@lo:503: 00000100:00100000:0.0:1788309395.431403:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309395.431432:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d120b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788309395.431450:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210468992 00000100:00100000:0.0:1788309395.431454:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210468992 00000100:00100000:0.0:1788309395.431484:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788309395.431492:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6a6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+13:5834:x1875178210468992:12345-0@lo:503: 00000100:00100000:0.0:1788309395.432143:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6a6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+13:5834:x1875178210468992:12345-0@lo:503: Request processed in 649us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309395.432153:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788309395.432209:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8c89fa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210468992:0@lo:503: 00000100:00100000:0.0:1788309395.432469:0:6889:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8c89fa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:6889:1875178210469120:0@lo:502: 00000100:00100000:0.0:1788309395.432808:0:6889:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309395.432853:0:6889:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d120b300 going to sleep for 11 seconds 00000100:00100000:3.0:1788309395.433132:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210469120 00000100:00100000:3.0:1788309395.433139:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210469120 00000100:00100000:3.0:1788309395.433186:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788309395.433196:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6a6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+13:6889:x1875178210469120:12345-0@lo:502: 00000100:00100000:3.0:1788309395.433600:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6a6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+13:6889:x1875178210469120:12345-0@lo:502: Request processed in 403us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309395.433615:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788309395.434314:0:6889:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8c89fa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:6889:1875178210469120:0@lo:502: 00000100:00100000:0.0:1788309395.434395:0:6889:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8c89fa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:6889:1875178210469248:0@lo:502: 00000100:00100000:0.0:1788309395.434444:0:6889:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309395.434482:0:6889:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d120b300 going to sleep for 11 seconds 00000100:00100000:3.0:1788309395.434832:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210469248 00000100:00100000:3.0:1788309395.434840:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210469248 00000100:00100000:3.0:1788309395.434890:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788309395.434900:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6b2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+13:6889:x1875178210469248:12345-0@lo:502: 00000100:00100000:3.0:1788309395.435121:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6b2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+13:6889:x1875178210469248:12345-0@lo:502: Request processed in 221us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309395.435127:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788309395.435218:0:6889:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8c89fa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:6889:1875178210469248:0@lo:502: 00000040:00080000:0.0:1788309395.435240:0:6889:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1788309395.435863:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1788309395.435888:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788309395.435901:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8c153a400/0x63a04852f46284a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f46284a9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309395.435913:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff97c8c153a400/0x63a04852f46284a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f46284a9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788309395.435924:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788309395.435927:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff97c8e07b1000 from 4 10000000:01000000:3.0:1788309395.435930:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788309395.435968:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8c153a000/0x63a04852f46284b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309395.435976:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff97c8c153a000/0x63a04852f46284b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309395.435987:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff97c8c153a000/0x63a04852f46284b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309395.436007:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e667fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210469376:0@lo:101: 00000100:00100000:3.0:1788309395.436064:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309395.436108:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c826df00 going to sleep for 11 seconds 00000100:00100000:0.0:1788309395.438707:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210469376 00000100:00100000:0.0:1788309395.438725:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210469376 00000100:00100000:0.0:1788309395.438811:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788309395.438832:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6b2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+13:5834:x1875178210469376:12345-0@lo:101: 00010000:00010000:0.0:1788309395.438853:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788309395.438879:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c8d73ef000/0x63a04852f46284b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x63a04852f46284b0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309395.438911:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8d73ef000/0x63a04852f46284b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63a04852f46284b0 expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309395.438923:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c8d73ef000/0x63a04852f46284b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f46284b0 expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309395.438935:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8d73ef000, rc 0) 00000100:00100000:0.0:1788309395.439046:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6b2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+14:5834:x1875178210469376:12345-0@lo:101: Request processed in 224us (2980us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309395.439053:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788309395.439408:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e667fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210469376:0@lo:101: 00010000:00010000:2.0:1788309395.439430:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff97c8c153a000/0x63a04852f46284b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f46284b7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309395.439440:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff97c8c153a000/0x63a04852f46284b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x63a04852f46284b7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309395.439532:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ec687800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210469504:0@lo:256: 00000100:00100000:2.0:1788309395.439745:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309395.439777:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8e646ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1788309395.439844:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210469504 00000100:00100000:3.0:1788309395.439849:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210469504 00000100:00100000:3.0:1788309395.439885:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788309395.439893:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6b2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+14:5834:x1875178210469504:12345-0@lo:256: 20000000:01000000:3.0:1788309395.439909:0:5832:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788309395.439928:0:5832:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788309395.439931:0:5832:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1788309395.440026:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6b2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+14:5834:x1875178210469504:12345-0@lo:256: Request processed in 134us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309395.440033:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788309395.440070:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ec687800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210469504:0@lo:256: 10000000:01000000:3.0:1788309395.440117:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788309395.440125:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8c153a000/0x63a04852f46284b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f46284b7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309395.440135:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff97c8c153a000/0x63a04852f46284b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f46284b7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788309395.440147:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788309395.440150:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1788309395.440153:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788309395.440178:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8c153ba00/0x63a04852f46284be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309395.440187:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff97c8c153ba00/0x63a04852f46284be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309395.440206:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff97c8c153ba00/0x63a04852f46284be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309395.440220:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e667c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210469632:0@lo:101: 00000100:00100000:3.0:1788309395.440249:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309395.440263:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c826df00 going to sleep for 11 seconds 00000100:00100000:3.0:1788309395.440303:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210469632 00000100:00100000:3.0:1788309395.440307:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210469632 00000100:00100000:3.0:1788309395.440329:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788309395.440335:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6b2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+14:5834:x1875178210469632:12345-0@lo:101: 00010000:00010000:3.0:1788309395.440343:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309395.441542:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c8c153b800/0x63a04852f46284c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x63a04852f46284be expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309395.441793:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8c153b800/0x63a04852f46284c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63a04852f46284be expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309395.441807:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c8c153b800/0x63a04852f46284c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f46284be expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309395.441817:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8c153b800, rc 0) 00000100:00100000:3.0:1788309395.441919:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6b2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+15:5834:x1875178210469632:12345-0@lo:101: Request processed in 1582us (1667us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309395.441927:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788309395.442481:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e667c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210469632:0@lo:101: 00010000:00010000:0.0:1788309395.442529:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff97c8c153ba00/0x63a04852f46284be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f46284c5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309395.442540:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff97c8c153ba00/0x63a04852f46284be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x63a04852f46284c5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309395.444792:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e667e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210469760:0@lo:501: 00000100:00100000:3.0:1788309395.444891:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309395.444948:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c37fbcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788309395.445301:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210469760 00000100:00100000:0.0:1788309395.445310:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210469760 00000100:00100000:0.0:1788309395.445372:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788309395.445383:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6b2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+15:5834:x1875178210469760:12345-0@lo:501: 00000100:00100000:0.0:1788309395.446023:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6b2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+15:5834:x1875178210469760:12345-0@lo:501: Request processed in 640us (1131us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309395.446031:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788309395.446265:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e667e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210469760:0@lo:501: 00000100:00100000:1.0:1788309395.446423:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8f4ce3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210469888:0@lo:503: 00000100:00100000:1.0:1788309395.446477:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309395.446523:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d69c2e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788309395.449036:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210469888 00000100:00100000:2.0:1788309395.449056:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210469888 00000100:00100000:2.0:1788309395.449137:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788309395.449150:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6b2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+15:5834:x1875178210469888:12345-0@lo:503: 00000100:00100000:2.0:1788309395.449693:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6b2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+15:5834:x1875178210469888:12345-0@lo:503: Request processed in 542us (3211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309395.449703:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788309395.449990:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8f4ce3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210469888:0@lo:503: 00000100:00100000:1.0:1788309395.464904:0:6891:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8f4ce3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:6891:1875178210470016:0@lo:502: 00000100:00100000:1.0:1788309395.465104:0:6891:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309395.465165:0:6891:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d69c2300 going to sleep for 11 seconds 00000100:00100000:0.0:1788309395.465560:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210470016 00000100:00100000:0.0:1788309395.465572:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210470016 00000100:00100000:0.0:1788309395.465633:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788309395.465646:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6b2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+15:6891:x1875178210470016:12345-0@lo:502: 00000100:00100000:0.0:1788309395.466063:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6b2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+15:6891:x1875178210470016:12345-0@lo:502: Request processed in 417us (958us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309395.466072:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788309395.466296:0:6891:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8f4ce3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:6891:1875178210470016:0@lo:502: 00000020:01000000:1.0:1788309395.466337:0:6891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788309395.466349:0:6891:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788309395.466921:0:6891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788309395.466925:0:6891:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788309395.467262:0:6891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788309395.467269:0:6891:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.155@tcp to nid 0x20000c0a8ca9b (192.168.202.155@tcp) 00000020:01000000:1.0:1788309395.467338:0:6891:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788309395.467342:0:6891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788309395.467925:0:6891:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff97c8eff499b8) 00000020:00000080:1.0:1788309395.468075:0:6891:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1788309395.468084:0:6891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788309395.468809:0:6891:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788309395.468831:0:6891:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788309395.468845:0:6891:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x63a04852f46284d3 00010000:00080000:1.0:1788309395.468902:0:6891:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97c8e6954800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.155@tcp at head 00010000:00010000:1.0:1788309395.470307:0:6891:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1788309395.583070:0:6891:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1788309395.583101:0:6891:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788309395.583772:0:6891:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788309395.583953:0:6891:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788309395.584006:0:6891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1788309395.584071:0:6891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1788309395.593890:0:6901:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788309395.593902:0:6901:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788309395.597887:0:6891:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788309395.597913:0:6891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788309395.597971:0:6891:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788309395.598007:0:6891:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x63a04852f46284da 00000100:00080000:0.0:1788309395.598025:0:6891:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788309395.598034:0:6891:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff97c8e6954800 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:0.0:1788309395.598086:0:6891:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97c8c89fa680 x1875178210470144/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788309395.600893:0:6891:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:1.0:1788309395.600969:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8c89fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875178210470144:0@lo:8: 00000100:00100000:1.0:1788309395.601066:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309395.601781:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210470144 00000100:00100000:2.0:1788309395.601795:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210470144 00000100:00100000:2.0:1788309395.601863:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788309395.601874:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f4ce3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3299:x1875178210470144:12345-0@lo:8: 00010000:00080000:2.0:1788309395.601917:0:6680:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 158 last 0 00000020:00000080:2.0:1788309395.601964:0:6680:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x63a04852f46284e1 00002000:00100000:2.0:1788309395.602033:0:6680:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff97c8efc15800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211392d ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788309395.602039:0:6680:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:2.0:1788309395.602044:0:6680:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1788309395.602212:0:6680:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788309395.602460:0:6680:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788309395.602496:0:6680:0:(import.c:65:import_set_state_nolock()) ffff97c8efc16000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788309395.602612:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f4ce3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3299:x1875178210470144:12345-0@lo:8: Request processed in 738us (1545us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309395.602622:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788309395.602688:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97c8c89fa680 x1875178210470144/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788309405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788309395.602703:0:3299:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788309395.602713:0:3299:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788309395.602723:0:3299:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788309395.602729:0:3299:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788309395.602732:0:3299:0:(import.c:65:import_set_state_nolock()) ffff97c8e6954800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788309395.602747:0:3299:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788309395.602753:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8c89fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875178210470144:0@lo:8: 00000004:00080000:2.0:1788309395.602788:0:6901:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000020:01000000:0.0:1788309395.602977:0:6891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788309395.602988:0:6891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788309395.602990:0:6891:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788309395.602994:0:6891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788309395.602999:0:6891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788309395.603001:0:6891:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788309395.603004:0:6891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788309395.603006:0:6891:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788309395.603051:0:6891:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8c89faa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:6891:1875178210470272:0@lo:502: 00000100:00100000:0.0:1788309395.603124:0:6891:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309395.603163:0:6891:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8edd33cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788309395.603188:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210470272 00000100:00100000:0.0:1788309395.603194:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210470272 00000100:00100000:0.0:1788309395.603234:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788309395.603243:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6b2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+15:6891:x1875178210470272:12345-0@lo:502: 00000100:00100000:0.0:1788309395.603551:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6b2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+15:6891:x1875178210470272:12345-0@lo:502: Request processed in 309us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309395.603559:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788309395.603620:0:6891:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8c89faa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:6891:1875178210470272:0@lo:502: 00000020:01000000:0.0:1788309395.603642:0:6891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788309395.603647:0:6891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788309395.603648:0:6891:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788309395.603652:0:6891:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:0.0:1788309395.603789:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1788309395.603809:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788309395.603831:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8c153ba00/0x63a04852f46284be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f46284c5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309395.603858:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff97c8c153ba00/0x63a04852f46284be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f46284c5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788309395.603870:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788309395.603873:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff97c8e661b370 from 1 10000000:01000000:0.0:1788309395.603877:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788309395.603907:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8d73ee800/0x63a04852f46284e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309395.603916:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff97c8d73ee800/0x63a04852f46284e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309395.603926:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff97c8d73ee800/0x63a04852f46284e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309395.603942:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8c89faa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210470400:0@lo:101: 00000100:00100000:0.0:1788309395.603974:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309395.604000:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8edd33cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788309395.604018:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210470400 00000100:00100000:0.0:1788309395.604022:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210470400 00000100:00100000:0.0:1788309395.604043:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788309395.604050:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6b2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+15:5834:x1875178210470400:12345-0@lo:101: 00010000:00010000:0.0:1788309395.604060:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788309395.604075:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c8d73eea00/0x63a04852f46284ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x63a04852f46284e8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309395.604099:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8d73eea00/0x63a04852f46284ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63a04852f46284e8 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309395.604126:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c8d73eea00/0x63a04852f46284ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f46284e8 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309395.604136:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8d73eea00, rc 0) 00000100:00100000:0.0:1788309395.604171:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6b2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+16:5834:x1875178210470400:12345-0@lo:101: Request processed in 120us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309395.604177:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788309395.604211:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8c89faa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210470400:0@lo:101: 00010000:00010000:0.0:1788309395.604225:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff97c8d73ee800/0x63a04852f46284e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f46284ef expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309395.604236:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff97c8d73ee800/0x63a04852f46284e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x63a04852f46284ef expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309395.604314:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8c89faa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210470528:0@lo:501: 00000100:00100000:0.0:1788309395.604344:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309395.604365:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8edd33cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788309395.604379:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210470528 00000100:00100000:0.0:1788309395.604383:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210470528 00000100:00100000:0.0:1788309395.604405:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788309395.604413:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6ae8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+16:5834:x1875178210470528:12345-0@lo:501: 00000100:00100000:0.0:1788309395.604668:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6ae8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+16:5834:x1875178210470528:12345-0@lo:501: Request processed in 255us (323us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788309395.604675:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788309395.604708:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8c89faa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210470528:0@lo:501: 10000000:01000000:0.0:1788309395.604730:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788309395.604743:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8d73ee800/0x63a04852f46284e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f46284ef expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309395.604751:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff97c8d73ee800/0x63a04852f46284e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f46284ef expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788309395.608025:0:6901:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 158358743742ns, next at 0ns, rc = 0 00000100:00100000:0.0:1788309395.620123:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ec685500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875178210470656:0@lo:400: 00000100:00100000:0.0:1788309395.620237:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309395.620346:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788309395.620366:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ec684700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875178210470784:0@lo:400: 00000100:00100000:0.0:1788309395.620403:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309395.620470:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210470656 00000100:00100000:0.0:1788309395.620481:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210470656 00000100:00100000:2.0:1788309395.622806:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210470784 00000100:00100000:2.0:1788309395.622831:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210470784 00000100:00100000:2.0:1788309395.622907:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788309395.622919:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c89fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875178210470784:12345-0@lo:400: 00000100:00100000:2.0:1788309395.623038:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c89fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875178210470784:12345-0@lo:400: Request processed in 121us (2635us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309395.623045:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788309395.623942:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97c8ec684700 x1875178210470784/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309411 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788309395.623963:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ec684700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875178210470784:0@lo:400: 00000100:00080000:2.0:1788309395.623996:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788309395.624144:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788309395.624157:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c89faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875178210470656:12345-0@lo:400: 00000100:00100000:0.0:1788309395.624224:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c89faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875178210470656:12345-0@lo:400: Request processed in 71us (3988us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309395.624232:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788309395.634419:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97c8ec685500 x1875178210470656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309411 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788309395.634444:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ec685500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875178210470656:0@lo:400: 00000004:00080000:2.0:1788309395.720413:0:6902:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1788309395.720466:0:6902:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ec684700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6902:1875178210471040:0@lo:7: 00000100:00100000:2.0:1788309395.720570:0:6902:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309395.720652:0:6902:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8e646bf00 going to sleep for 11 seconds 00000004:00080000:2.0:1788309395.720703:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:2.0:1788309395.720746:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210471040 00000100:00100000:2.0:1788309395.720755:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210471040 00000100:00100000:2.0:1788309395.720849:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788309395.720864:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ec687b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6902:x1875178210471040:12345-0@lo:7: 00000100:00100000:3.0:1788309395.722273:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ec685500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210470912:0@lo:13: 00000100:00100000:3.0:1788309395.722404:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788309395.729910:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788309395.735461:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210470912 00000100:00100000:3.0:1788309395.735479:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210470912 00000100:00100000:3.0:1788309395.735550:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788309395.735560:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e667dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3300:x1875178210470912:12345-0@lo:13: 00002000:00000024:3.0:1788309395.735605:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1788309395.735703:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e667dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3300:x1875178210470912:12345-0@lo:13: Request processed in 142us (13300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309395.735721:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788309395.735777:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97c8ec685500 x1875178210470912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788309411 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788309395.735803:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ec685500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210470912:0@lo:13: 00002000:00080000:2.0:1788309395.759844:0:6682:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1788309395.759857:0:6682:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1788309395.760090:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ec687b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6902:x1875178210471040:12345-0@lo:7: Request processed in 39223us (39515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309395.760104:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788309395.762806:0:6902:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97c8ec684700 x1875178210471040/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788309411 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788309395.762842:0:6902:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ec684700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6902:1875178210471040:0@lo:7: 00000004:00080000:3.0:1788309395.762862:0:6902:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1788309395.762923:0:6902:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e667d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6902:1875178210471168:0@lo:5: 00000100:00100000:3.0:1788309395.763002:0:6902:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309395.763066:0:6902:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8eff1ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1788309395.764716:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210471168 00000100:00100000:2.0:1788309395.764732:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210471168 00000100:00100000:2.0:1788309395.764878:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788309395.764896:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e667ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6902:x1875178210471168:12345-0@lo:5: 00002000:00080000:2.0:1788309395.764946:0:6681:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1788309395.764951:0:6681:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1788309395.768271:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e667ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6902:x1875178210471168:12345-0@lo:5: Request processed in 3370us (5258us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788309395.768304:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788309395.776215:0:6902:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97c8e667d880 x1875178210471168/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788309411 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788309395.776249:0:6902:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e667d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6902:1875178210471168:0@lo:5: 00000004:00080000:2.0:1788309395.776273:0:6902:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1788309395.776463:0:6902:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ec684000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6902:1875178210471296:0@lo:700: 00000100:00100000:2.0:1788309395.776751:0:6902:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309395.776813:0:6902:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8e646bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788309395.778518:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210471296 00000100:00100000:0.0:1788309395.778536:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210471296 00000100:00100000:0.0:1788309395.778620:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788309395.778636:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ec686300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6902:x1875178210471296:12345-0@lo:700: 00000100:00100000:0.0:1788309395.778711:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8c89f9500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6689:1875178210471424:0@lo:700: 00000100:00100000:0.0:1788309395.778781:0:6689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309395.778833:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c2c2f600 going to sleep for 11 seconds 00000100:00100000:0.0:1788309395.778866:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210471424 00000100:00100000:0.0:1788309395.778870:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210471424 00000100:00100000:0.0:1788309395.778905:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788309395.778930:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c89f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6689:x1875178210471424:12345-0@lo:700: 40000000:02000000:0.0:1788309395.856271:0:5844:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:0.0:1788309395.864919:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c89f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6689:x1875178210471424:12345-0@lo:700: Request processed in 85975us (86121us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309395.864939:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788309395.865270:0:6689:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97c8c89f9500 x1875178210471424/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788309411 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788309395.865333:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8c89f9500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6689:1875178210471424:0@lo:700: 40000000:02000000:2.0:1788309395.865364:0:6689:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:0.0:1788309396.023419:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ec686300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6902:x1875178210471296:12345-0@lo:700: Request processed in 244774us (246656us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309396.023439:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788309396.023468:0:6902:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97c8ec684000 x1875178210471296/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788309411 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788309396.023490:0:6902:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ec684000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6902:1875178210471296:0@lo:700: 00000001:00080000:2.0:1788309396.024847:0:6706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:2.0:1788309396.024863:0:6706:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000004:02000040:2.0:1788309396.119683:0:6902:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:3.0:1788309396.125251:0:6902:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e667d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6902:1875178210471552:0@lo:5: 00000100:00100000:3.0:1788309396.126095:0:6902:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309396.126186:0:6902:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8eff1e480 going to sleep for 11 seconds 00000100:00100000:0.0:1788309396.126883:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210471552 00000100:00100000:0.0:1788309396.126897:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210471552 00000100:00100000:0.0:1788309396.126977:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788309396.126989:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e667e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6902:x1875178210471552:12345-0@lo:5: 00002000:00080000:0.0:1788309396.150512:0:6682:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1788309396.150541:0:6682:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:0.0:1788309396.156543:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e667e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6902:x1875178210471552:12345-0@lo:5: Request processed in 29542us (30437us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788309396.156563:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788309396.156932:0:6902:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97c8e667d180 x1875178210471552/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788309412 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788309396.156950:0:6902:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788309396.156969:0:6902:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff97c8e667d180 x1875178210471552/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788309412 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788309396.156991:0:6902:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e667d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6902:1875178210471552:0@lo:5: 00000004:00080000:2.0:1788309396.157009:0:6902:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:3.0:1788309396.196720:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309397.230499:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309398.241172:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788309399.246472:0:7050:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg255-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788309399.264631:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309400.298102:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788309401.057389:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8f4ce2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3301:1875178210471680:0@lo:400: 00000100:00100000:1.0:1788309401.057482:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309401.057541:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788309401.057548:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8f4ce0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210472064:0@lo:400: 00000100:00100000:1.0:1788309401.057576:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309401.057606:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8f4ce2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875178210471808:0@lo:400: 00000100:00100000:1.0:1788309401.057633:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309401.057651:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788309401.057656:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8f4ce3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875178210471936:0@lo:400: 00000100:00100000:1.0:1788309401.057681:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309401.057711:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210471680 00000100:00100000:1.0:1788309401.057720:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210471680 00000100:00100000:1.0:1788309401.057780:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788309401.057791:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6ae8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+16:3301:x1875178210471680:12345-0@lo:400: 00000100:00100000:1.0:1788309401.057845:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6ae8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+16:3301:x1875178210471680:12345-0@lo:400: Request processed in 55us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309401.057852:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788309401.057903:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210472064 00000100:00100000:1.0:1788309401.057907:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210472064 00000100:00100000:1.0:1788309401.057945:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788309401.057951:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f4ce2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3301:x1875178210472064:12345-0@lo:400: 00000100:00100000:1.0:1788309401.057981:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f4ce2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3301:x1875178210472064:12345-0@lo:400: Request processed in 31us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309401.057987:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788309401.058005:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210471808 00000100:00100000:1.0:1788309401.058008:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210471808 00000100:00100000:1.0:1788309401.058030:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210471936 00000100:00100000:1.0:1788309401.058033:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210471936 00000100:00100000:1.0:1788309401.058047:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788309401.058060:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f4ce3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875178210471808:12345-0@lo:400: 00000100:00100000:1.0:1788309401.058093:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f4ce3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875178210471808:12345-0@lo:400: Request processed in 35us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309401.058099:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788309401.058111:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788309401.058116:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f4ce1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875178210471936:12345-0@lo:400: 00000100:00100000:1.0:1788309401.058139:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f4ce1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875178210471936:12345-0@lo:400: Request processed in 23us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309401.058144:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1788309401.058166:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788309401.058170:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788309401.058201:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97c8f4ce3480 x1875178210471936/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788309401.058214:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8f4ce3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875178210471936:0@lo:400: 00010000:00080000:1.0:1788309401.058223:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97c8f4ce2680 x1875178210471808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788309401.058230:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8f4ce2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875178210471808:0@lo:400: 00010000:00080000:1.0:1788309401.058261:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97c8f4ce0380 x1875178210472064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788309417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788309401.058270:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8f4ce0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210472064:0@lo:400: 00000100:00100000:1.0:1788309401.058300:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8f4ce2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3301:1875178210471680:0@lo:400: 00000100:00100000:2.0:1788309401.065584:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788309401.065614:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ec684000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210472192:0@lo:13: 00000100:00100000:2.0:1788309401.065692:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309401.065745:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210472192 00000100:00100000:2.0:1788309401.065753:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210472192 00000100:00100000:2.0:1788309401.065821:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788309401.065831:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ec684700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1875178210472192:12345-0@lo:13: 00002000:00000024:2.0:1788309401.065865:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788309401.065919:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ec684700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1875178210472192:12345-0@lo:13: Request processed in 88us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309401.065925:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788309401.065962:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97c8ec684000 x1875178210472192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788309417 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788309401.067999:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ec684000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210472192:0@lo:13: 00000001:00080000:3.0:1788309401.234242:0:6706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:1.0:1788309401.312820:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309402.341159:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309403.366638:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309404.387187:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309405.416123:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788309406.176505:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ec684000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875178210472320:0@lo:13: 00000100:00100000:2.0:1788309406.176584:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309406.176672:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210472320 00000100:00100000:0.0:1788309406.176688:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210472320 00000100:00100000:0.0:1788309406.176788:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788309406.176800:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ec685500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875178210472320:12345-0@lo:13: 00002000:00000024:0.0:1788309406.176863:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788309406.176957:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ec685500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875178210472320:12345-0@lo:13: Request processed in 159us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309406.176966:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788309406.177045:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97c8ec684000 x1875178210472320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788309422 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788309406.177058:0:3302:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00080000:2.0:1788309406.177087:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788309406.177101:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ec684000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875178210472320:0@lo:13: 00000100:00100000:2.0:1788309406.181213:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ec687100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875178210472576:0@lo:400: 00000100:00100000:2.0:1788309406.183307:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309406.184582:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788309406.184599:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ec684380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875178210472704:0@lo:400: 00000100:00100000:2.0:1788309406.187553:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309406.187754:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ec687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3303:1875178210472448:0@lo:400: 00000100:00100000:2.0:1788309406.187809:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309406.187854:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210472448 00000100:00100000:2.0:1788309406.187862:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210472448 00000100:00100000:2.0:1788309406.187905:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788309406.187915:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aeb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+16:3303:x1875178210472448:12345-0@lo:400: 00000100:00100000:2.0:1788309406.187970:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aeb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+16:3303:x1875178210472448:12345-0@lo:400: Request processed in 57us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309406.187977:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788309406.188026:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ec687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3303:1875178210472448:0@lo:400: 00000100:00100000:0.0:1788309406.188857:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210472576 00000100:00100000:0.0:1788309406.188865:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210472576 00000100:00100000:0.0:1788309406.188897:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210472704 00000100:00100000:0.0:1788309406.188900:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210472704 00000100:00100000:0.0:1788309406.188921:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788309406.188928:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ec686a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875178210472576:12345-0@lo:400: 00000100:00100000:0.0:1788309406.188981:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ec686a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875178210472576:12345-0@lo:400: Request processed in 53us (5680us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309406.188986:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788309406.188999:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788309406.189004:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ec687480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875178210472704:12345-0@lo:400: 00000100:00100000:0.0:1788309406.189029:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ec687480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875178210472704:12345-0@lo:400: Request processed in 25us (1484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309406.189035:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1788309406.189523:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788309406.189557:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97c8ec684380 x1875178210472704/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309422 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788309406.189572:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ec684380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875178210472704:0@lo:400: 00010000:00080000:2.0:1788309406.189583:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97c8ec687100 x1875178210472576/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309422 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788309406.189591:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ec687100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875178210472576:0@lo:400: 00010000:00010000:2.0:1788309406.433479:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309407.458584:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309408.481464:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309409.512668:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309410.528722:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788309411.301523:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ec687100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3302:1875178210472832:0@lo:400: 00000100:00100000:2.0:1788309411.301605:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309411.301655:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788309411.301660:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ec684380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875178210472960:0@lo:400: 00000100:00100000:2.0:1788309411.304215:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309411.304360:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ec687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875178210473088:0@lo:400: 00000100:00100000:2.0:1788309411.304423:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309411.304448:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788309411.304455:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ec686680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210473216:0@lo:400: 00000100:00100000:2.0:1788309411.304483:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309411.304518:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210472832 00000100:00100000:2.0:1788309411.304525:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210472832 00000100:00100000:2.0:1788309411.304572:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788309411.304581:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6ae9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+16:3302:x1875178210472832:12345-0@lo:400: 00000100:00100000:2.0:1788309411.304633:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6ae9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+16:3302:x1875178210472832:12345-0@lo:400: Request processed in 53us (3028us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309411.304641:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788309411.304674:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210473216 00000100:00100000:2.0:1788309411.304693:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210473216 00000100:00100000:2.0:1788309411.305925:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788309411.305937:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ec684a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1875178210473216:12345-0@lo:400: 00000100:00100000:2.0:1788309411.306004:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ec684a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1875178210473216:12345-0@lo:400: Request processed in 69us (1519us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309411.306010:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788309411.313457:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210472960 00000100:00100000:0.0:1788309411.313475:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210472960 00000100:00100000:0.0:1788309411.313522:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210473088 00000100:00100000:0.0:1788309411.313525:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210473088 00000100:00100000:0.0:1788309411.313552:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788309411.313562:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ec686d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875178210472960:12345-0@lo:400: 00000100:00100000:0.0:1788309411.313654:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ec686d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875178210472960:12345-0@lo:400: Request processed in 93us (11952us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309411.313662:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788309411.316942:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788309411.316964:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ec685f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875178210473088:12345-0@lo:400: 00000100:00100000:0.0:1788309411.317069:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ec685f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875178210473088:12345-0@lo:400: Request processed in 115us (12645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309411.317077:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1788309411.318330:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788309411.318337:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788309411.318381:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97c8ec684380 x1875178210472960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309427 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788309411.318398:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ec684380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875178210472960:0@lo:400: 00000100:00100000:3.0:1788309411.318412:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ec687100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3302:1875178210472832:0@lo:400: 00010000:00080000:1.0:1788309411.320421:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97c8ec686680 x1875178210473216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788309427 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788309411.320455:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ec686680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210473216:0@lo:400: 00010000:00080000:1.0:1788309411.320472:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97c8ec687800 x1875178210473088/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309427 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788309411.320482:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ec687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875178210473088:0@lo:400: 00000100:00100000:2.0:1788309411.323059:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788309411.323098:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8f4ce2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210473344:0@lo:13: 00000100:00100000:2.0:1788309411.323178:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309411.334457:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210473344 00000100:00100000:0.0:1788309411.334472:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210473344 00000100:00100000:0.0:1788309411.334526:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788309411.334537:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ec685880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210473344:12345-0@lo:13: 00002000:00000024:0.0:1788309411.334580:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788309411.334697:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ec685880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210473344:12345-0@lo:13: Request processed in 160us (11517us total) trans 0 rc 0/0 00010000:00080000:2.0:1788309411.335911:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97c8f4ce2d80 x1875178210473344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788309427 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788309411.335942:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8f4ce2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210473344:0@lo:13: 00000100:00100000:0.0:1788309411.336001:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000004:1.0:1788309411.447500:0:7621:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788309411.447504:0:7621:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1788309411.447645:0:7621:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff97c8f519c800 00000020:01000004:1.0:1788309411.447661:0:7621:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1788309411.447687:0:7621:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1788309411.447793:0:7621:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff97c8eff48000) 00000020:00000080:1.0:1788309411.447811:0:7621:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788309411.471637:0:7621:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1788309411.471983:0:7621:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1788309411.519577:0:7621:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788309411.538292:0:7621:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788309411.538334:0:7621:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788309411.538393:0:7621:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788309411.538420:0:7621:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788309411.540246:0:7621:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788309411.540262:0:7621:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788309411.540274:0:7621:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x63a04852f46284fd 00000020:01000004:2.0:1788309411.540767:0:7621:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1788309411.540792:0:7621:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.155@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788309411.540795:0:7621:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.155@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788309411.540802:0:7621:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788309411.540826:0:7621:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1788309411.540830:0:7621:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.155@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00010000:00010000:0.0:1788309411.560217:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1788309411.585879:0:7621:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.155@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788309411.585926:0:7621:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.155@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1788309411.585930:0:7621:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788309411.585932:0:7621:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788309411.585933:0:7621:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788309411.585934:0:7621:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788309411.585935:0:7621:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788309411.585936:0:7621:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788309411.585938:0:7621:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788309411.585939:0:7621:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788309411.585940:0:7621:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788309411.585942:0:7621:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788309411.585943:0:7621:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788309411.585947:0:7621:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1788309411.585949:0:7621:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788309411.585950:0:7621:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788309411.585951:0:7621:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788309411.585952:0:7621:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788309411.585953:0:7621:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788309411.585954:0:7621:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788309411.585955:0:7621:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788309411.585956:0:7621:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788309411.585957:0:7621:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788309411.585958:0:7621:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788309411.585965:0:7621:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788309411.586000:0:7621:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788309411.586021:0:7621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e667c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:7621:1875178210473472:0@lo:253: 00000100:00100000:3.0:1788309411.586091:0:7621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309411.586143:0:7621:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8eff1e780 going to sleep for 11 seconds 00000100:00100000:2.0:1788309411.586523:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210473472 00000100:00100000:2.0:1788309411.586532:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210473472 00000100:00100000:2.0:1788309411.586590:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788309411.586600:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+16:7621:x1875178210473472:12345-0@lo:253: 20000000:01000000:2.0:1788309411.586631:0:5830:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788309411.586636:0:5830:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1788309411.586641:0:5830:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1788309411.586645:0:5830:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:2.0:1788309411.588304:0:5830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788309411.588657:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1788309411.588672:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1788309411.588798:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1788309411.588807:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1788309411.588839:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1788309411.588893:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1788309411.590654:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1788309411.590695:0:5830:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.155@tcp 20000000:01000000:2.0:1788309411.590781:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.155@tcp (null) (null) (null) 00000040:00080000:2.0:1788309411.590825:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1788309411.590834:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788309411.590888:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1788309411.590897:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.155@tcp (null) (null) 00000040:00080000:2.0:1788309411.590931:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1788309411.590940:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1788309411.590987:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1788309411.591182:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1788309411.592700:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:0.0:1788309411.592803:0:5830:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.155@tcp 20000000:01000000:0.0:1788309411.592805:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.155@tcp (null) (null) (null) 00000040:00080000:0.0:1788309411.592845:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:0.0:1788309411.592853:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788309411.592886:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:0.0:1788309411.592894:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.155@tcp (null) (null) 00000040:00080000:0.0:1788309411.592928:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:0.0:1788309411.592939:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788309411.592986:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:0.0:1788309411.593165:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:0.0:1788309411.593185:0:5830:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:0.0:1788309411.593189:0:5830:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:0.0:1788309411.593195:0:5830:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788309411.593197:0:5830:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788309411.593212:0:5830:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788309411.593225:0:5830:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788309411.593228:0:5830:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788309411.595606:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788309411.595613:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788309411.596949:0:7623:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1788309411.597178:0:7623:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1788309411.597240:0:7623:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1788309411.598196:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:1.0:1788309411.598234:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:1.0:1788309411.598309:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:1.0:1788309411.598331:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788309411.598333:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788309411.599111:0:7624:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:0.0:1788309411.599160:0:7624:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:0.0:1788309411.599206:0:7624:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1788309411.599615:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1788309411.599661:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1788309411.599855:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1788309411.599870:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1788309411.599872:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788309411.600498:0:7625:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1788309411.600879:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1788309411.600922:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1788309411.600976:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1788309411.600990:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788309411.600992:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788309411.609984:0:7626:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:1.0:1788309411.610697:0:7626:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:1.0:1788309411.610813:0:7626:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:2.0:1788309411.613058:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:2.0:1788309411.613117:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:2.0:1788309411.613213:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 10000000:01000000:2.0:1788309411.613236:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788309411.613257:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97c8e26d8c00/0x63a04852f4628504 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309411.613487:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c8d73efe00/0x63a04852f4628455 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f462844e expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309411.613568:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c8c153bc00/0x63a04852f462847f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f4628478 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309411.613575:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c8d73eee00/0x63a04852f46284a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f46284a2 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309411.613582:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c8c153b800/0x63a04852f46284c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f46284be expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309411.613605:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c8d73eea00/0x63a04852f46284ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f46284e8 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309411.613613:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97c8e26d8c00/0x63a04852f4628504 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309411.613792:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c8d73eea00/0x63a04852f46284ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x63a04852f46284e8 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309411.613809:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97c8d73eea00/0x63a04852f46284ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x63a04852f46284e8 expref: 16 pid: 5831 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309411.613824:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ec685c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5830:1875178210473600:0@lo:104: 00000100:00100000:2.0:1788309411.613895:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788309411.613999:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c8c153b800/0x63a04852f46284c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x63a04852f46284be expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309411.614008:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97c8c153b800/0x63a04852f46284c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x63a04852f46284be expref: 16 pid: 5830 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309411.614016:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ec687800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5830:1875178210473728:0@lo:104: 00010000:00010000:2.0:1788309411.614043:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c8d73eee00/0x63a04852f46284a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x63a04852f46284a2 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309411.614052:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97c8d73eee00/0x63a04852f46284a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x63a04852f46284a2 expref: 16 pid: 5832 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309411.614060:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ec686680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5830:1875178210473856:0@lo:104: 00010000:00010000:2.0:1788309411.614106:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c8c153bc00/0x63a04852f462847f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x63a04852f4628478 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309411.614121:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97c8c153bc00/0x63a04852f462847f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x63a04852f4628478 expref: 16 pid: 5830 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309411.614130:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ec687100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5830:1875178210473984:0@lo:104: 00010000:00010000:2.0:1788309411.614155:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c8d73efe00/0x63a04852f4628455 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x63a04852f462844e expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309411.614163:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97c8d73efe00/0x63a04852f4628455 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x63a04852f462844e expref: 16 pid: 5831 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309411.614170:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ec684380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5830:1875178210474112:0@lo:104: 00000100:00100000:2.0:1788309411.614202:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8e0684000 going to sleep for 11 seconds 00000100:00100000:0.0:1788309411.617869:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788309411.617921:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309411.617956:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309411.617966:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309411.617975:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309411.617988:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210473600 00000100:00100000:0.0:1788309411.617997:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210473600 00000100:00100000:0.0:1788309411.618065:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210473728 00000100:00100000:0.0:1788309411.618068:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210473728 00000100:00100000:0.0:1788309411.618079:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210473856 00000100:00100000:0.0:1788309411.618081:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210473856 00000100:00100000:0.0:1788309411.618089:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210473984 00000100:00100000:0.0:1788309411.618091:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210473984 00000100:00100000:0.0:1788309411.618099:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210474112 00000100:00100000:0.0:1788309411.618101:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210474112 00000100:00100000:0.0:1788309411.618113:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788309411.618123:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8cf558450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+7:5830:x1875178210473600:12345-0@lo:104: 00010000:00010000:0.0:1788309411.618142:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff97c8d73ee800/0x63a04852f46284e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x63a04852f46284ef expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309411.618241:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788309411.618248:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8cf558450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+7:5830:x1875178210473600:12345-0@lo:104: Request processed in 127us (4353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309411.618256:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788309411.618317:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788309411.618335:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c89f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+6:5830:x1875178210473728:12345-0@lo:104: 00010000:00010000:0.0:1788309411.618374:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff97c8c153ba00/0x63a04852f46284be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x63a04852f46284c5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309411.618410:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788309411.618416:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c89f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+6:5830:x1875178210473728:12345-0@lo:104: Request processed in 93us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309411.618422:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788309411.618436:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788309411.618441:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c89fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+5:5830:x1875178210473856:12345-0@lo:104: 00010000:00010000:0.0:1788309411.618448:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff97c8c153a400/0x63a04852f46284a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x63a04852f46284a9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309411.618475:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788309411.618480:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c89fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+5:5830:x1875178210473856:12345-0@lo:104: Request processed in 40us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309411.618486:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788309411.618508:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788309411.618514:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c89f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+4:5830:x1875178210473984:12345-0@lo:104: 00010000:00010000:0.0:1788309411.618521:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff97c8d73ee200/0x63a04852f4628478 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x63a04852f462847f expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309411.618547:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788309411.618552:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c89f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+4:5830:x1875178210473984:12345-0@lo:104: Request processed in 39us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309411.618557:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788309411.618569:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788309411.618574:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c89f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+3:5830:x1875178210474112:12345-0@lo:104: 00010000:00010000:0.0:1788309411.618587:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8000/0x63a04852f462844e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x63a04852f4628455 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309411.618614:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1788309411.618630:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c89f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+3:5830:x1875178210474112:12345-0@lo:104: Request processed in 56us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309411.618637:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1788309411.618661:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788309411.618667:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff97c8d73ee800/0x63a04852f46284e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x63a04852f46284ef expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309411.618687:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8d73ee800 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:0.0:1788309411.618692:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff97c8d73ee800/0x63a04852f46284e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x63a04852f46284ef expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309411.619154:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ec685c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5830:1875178210473600:0@lo:104: 00000100:00100000:3.0:1788309411.619165:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ec687800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5830:1875178210473728:0@lo:104: 00000100:00100000:3.0:1788309411.619172:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ec686680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5830:1875178210473856:0@lo:104: 00000100:00100000:3.0:1788309411.619179:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ec687100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5830:1875178210473984:0@lo:104: 00000100:00100000:3.0:1788309411.619186:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ec684380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5830:1875178210474112:0@lo:104: 00010000:00010000:3.0:1788309411.619214:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97c8e26d8c00/0x63a04852f4628504 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309411.619254:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff97c8d73ee800/0x63a04852f46284e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x63a04852f46284ef expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788309411.619264:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff97c8d73ee800/0x63a04852f46284e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x63a04852f46284ef expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788309411.619271:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788309411.619339:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff97c8d73ee800/0x63a04852f46284e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f46284ef expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309411.619346:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788309411.619625:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1788309411.619697:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788309411.619908:0:7627:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788309411.619916:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff97c8c153ba00/0x63a04852f46284be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x63a04852f46284c5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309411.619924:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8c153ba00 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:2.0:1788309411.619928:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff97c8c153ba00/0x63a04852f46284be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x63a04852f46284c5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309411.619936:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff97c8c153ba00/0x63a04852f46284be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x63a04852f46284c5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788309411.619943:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff97c8c153ba00/0x63a04852f46284be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x63a04852f46284c5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788309411.619949:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788309411.619974:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff97c8c153ba00/0x63a04852f46284be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f46284c5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309411.619980:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788309411.619995:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff97c8c153ba00/0x63a04852f46284be lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f46284c5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309411.620002:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff97c8c153ba00/0x63a04852f46284be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f46284c5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309411.620016:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788309411.620019:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff97c8d73ee200/0x63a04852f4628478 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x63a04852f462847f expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309411.620038:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8d73ee200 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:2.0:1788309411.620041:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff97c8d73ee200/0x63a04852f4628478 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x63a04852f462847f expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309411.620048:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff97c8d73ee200/0x63a04852f4628478 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x63a04852f462847f expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788309411.620054:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff97c8d73ee200/0x63a04852f4628478 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x63a04852f462847f expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788309411.620059:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788309411.620072:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff97c8d73ee200/0x63a04852f4628478 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f462847f expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309411.620077:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788309411.620082:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff97c8d73ee200/0x63a04852f4628478 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f462847f expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309411.620099:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff97c8d73ee200/0x63a04852f4628478 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f462847f expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309411.620109:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788309411.620112:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8000/0x63a04852f462844e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x63a04852f4628455 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309411.620117:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d8000 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:2.0:1788309411.620120:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8000/0x63a04852f462844e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x63a04852f4628455 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309411.620127:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8000/0x63a04852f462844e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x63a04852f4628455 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788309411.620133:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8000/0x63a04852f462844e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x63a04852f4628455 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788309411.620138:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788309411.620151:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8000/0x63a04852f462844e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f4628455 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309411.620157:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788309411.620189:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff97c8d73ee800/0x63a04852f46284e8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f46284ef expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309411.620196:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff97c8d73ee800/0x63a04852f46284e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f46284ef expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309411.620212:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309411.620213:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309411.620215:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788309411.621947:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ec684000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3300:1875178210474368:0@lo:103: 00000100:00100000:1.0:1788309411.622060:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309411.622128:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788309411.622134:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ec684380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3300:1875178210474496:0@lo:103: 00000100:00100000:1.0:1788309411.622530:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309411.622571:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210474368 00000100:00100000:1.0:1788309411.622578:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210474368 00010000:00010000:1.0:1788309411.622610:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c8c153b800/0x63a04852f46284c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63a04852f46284be expref: 17 pid: 5830 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309411.622648:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210474496 00000100:00100000:1.0:1788309411.622652:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210474496 00010000:00010000:1.0:1788309411.622663:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c8c153bc00/0x63a04852f462847f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63a04852f4628478 expref: 18 pid: 5830 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309411.622688:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788309411.622697:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f4ce0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+18:3300:x1875178210474368:12345-0@lo:103: 00010000:00010000:1.0:1788309411.622879:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788309411.622886:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c8c153b800/0x63a04852f46284c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63a04852f46284be expref: 18 pid: 5830 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309411.622897:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c8c153b800/0x63a04852f46284c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x63a04852f46284be expref: 18 pid: 5830 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309411.622915:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c8c153b800/0x63a04852f46284c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x63a04852f46284be expref: 18 pid: 5830 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309411.622933:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788309411.622969:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f4ce0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+17:3300:x1875178210474368:12345-0@lo:103: Request processed in 273us (909us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309411.622975:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788309411.623014:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788309411.623021:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f4ce2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+16:3300:x1875178210474496:12345-0@lo:103: 00010000:00010000:1.0:1788309411.623133:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788309411.623138:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c8c153bc00/0x63a04852f462847f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63a04852f4628478 expref: 16 pid: 5830 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309411.623147:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c8c153bc00/0x63a04852f462847f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x63a04852f4628478 expref: 16 pid: 5830 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309411.623156:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c8c153bc00/0x63a04852f462847f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x63a04852f4628478 expref: 16 pid: 5830 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309411.623164:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788309411.623260:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f4ce2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+15:3300:x1875178210474496:12345-0@lo:103: Request processed in 239us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309411.623267:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788309411.623396:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ec684380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3300:1875178210474496:0@lo:103: 00000100:00100000:1.0:1788309411.623410:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ec684000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3300:1875178210474368:0@lo:103: 00010000:00010000:2.0:1788309411.626462:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8000/0x63a04852f462844e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f4628455 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309411.626480:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8000/0x63a04852f462844e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f4628455 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309411.626509:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309411.626527:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309411.626529:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309411.627020:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309411.627023:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309411.627024:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309411.627138:0:7627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff97c8c153a400/0x63a04852f46284a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x63a04852f46284a9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309411.627148:0:7627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8c153a400 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:2.0:1788309411.627152:0:7627:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff97c8c153a400/0x63a04852f46284a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x63a04852f46284a9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309411.627161:0:7627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff97c8c153a400/0x63a04852f46284a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x63a04852f46284a9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788309411.627169:0:7627:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff97c8c153a400/0x63a04852f46284a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x63a04852f46284a9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788309411.627174:0:7627:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788309411.627231:0:7627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff97c8c153a400/0x63a04852f46284a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f46284a9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309411.627238:0:7627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788309411.627253:0:7627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff97c8c153a400/0x63a04852f46284a2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f46284a9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309411.627260:0:7627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff97c8c153a400/0x63a04852f46284a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f46284a9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309411.627319:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ec686680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3303:1875178210474752:0@lo:103: 00000100:00100000:2.0:1788309411.627855:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788309411.627933:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309411.627935:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309411.627937:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788309411.627990:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210474752 00000100:00100000:0.0:1788309411.627999:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210474752 00010000:00010000:0.0:1788309411.628040:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c8d73eee00/0x63a04852f46284a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63a04852f46284a2 expref: 15 pid: 5832 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309411.628077:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788309411.628088:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ec687800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+15:3303:x1875178210474752:12345-0@lo:103: 00010000:00010000:0.0:1788309411.628102:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788309411.628107:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c8d73eee00/0x63a04852f46284a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63a04852f46284a2 expref: 15 pid: 5832 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309411.628117:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c8d73eee00/0x63a04852f46284a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x63a04852f46284a2 expref: 15 pid: 5832 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309411.628132:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c8d73eee00/0x63a04852f46284a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x63a04852f46284a2 expref: 15 pid: 5832 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309411.628147:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788309411.628201:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ec687800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+14:3303:x1875178210474752:12345-0@lo:103: Request processed in 114us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309411.628208:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788309411.628744:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ec686680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3303:1875178210474752:0@lo:103: 00000100:00100000:1.0:1788309411.629598:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ec687100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3302:1875178210474624:0@lo:103: 00000100:00100000:1.0:1788309411.629792:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309411.629880:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8c89f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3302:1875178210474240:0@lo:103: 00000100:00100000:1.0:1788309411.629906:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309411.630318:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210474624 00000100:00100000:0.0:1788309411.630327:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210474624 00010000:00010000:0.0:1788309411.630381:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c8d73efe00/0x63a04852f4628455 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63a04852f462844e expref: 14 pid: 5831 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309411.630406:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210474240 00000100:00100000:0.0:1788309411.630410:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210474240 00010000:00010000:0.0:1788309411.630421:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c8d73eea00/0x63a04852f46284ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63a04852f46284e8 expref: 15 pid: 5831 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309411.630436:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788309411.630444:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f4ce3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+15:3302:x1875178210474624:12345-0@lo:103: 00010000:00010000:0.0:1788309411.630457:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788309411.630462:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c8d73efe00/0x63a04852f4628455 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63a04852f462844e expref: 15 pid: 5831 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309411.630473:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c8d73efe00/0x63a04852f4628455 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x63a04852f462844e expref: 15 pid: 5831 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309411.630489:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c8d73efe00/0x63a04852f4628455 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x63a04852f462844e expref: 15 pid: 5831 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309411.630514:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788309411.630558:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f4ce3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+14:3302:x1875178210474624:12345-0@lo:103: Request processed in 114us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309411.630565:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788309411.630585:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788309411.630592:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f4ce0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+13:3302:x1875178210474240:12345-0@lo:103: 00010000:00010000:0.0:1788309411.630600:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788309411.630604:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c8d73eea00/0x63a04852f46284ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63a04852f46284e8 expref: 13 pid: 5831 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309411.630638:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c8d73eea00/0x63a04852f46284ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x63a04852f46284e8 expref: 13 pid: 5831 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309411.630649:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c8d73eea00/0x63a04852f46284ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x63a04852f46284e8 expref: 13 pid: 5831 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309411.630662:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97c8e26d8c00/0x63a04852f4628504 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309411.630682:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8e26d8c00/0x63a04852f4628504 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309411.630833:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ec687100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3302:1875178210474624:0@lo:103: 00010000:00010000:0.0:1788309411.631482:0:5821:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97c8e26d8c00/0x63a04852f4628504 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309411.631576:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97c8e26d8c00/0x63a04852f4628504 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309411.631584:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97c8e26d8c00/0x63a04852f4628504 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309411.631591:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97c8e26d8c00/0x63a04852f4628504 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309411.631598:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d8c00 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:0.0:1788309411.631602:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97c8e26d8c00/0x63a04852f4628504 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309411.631612:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97c8e26d8c00/0x63a04852f4628504 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309411.631659:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97c8e26d8c00/0x63a04852f4628504 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309411.631671:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788309411.631838:0:5830:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97c8e26d8c00/0x63a04852f4628504 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309411.631848:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97c8e26d8c00/0x63a04852f4628504 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309411.631854:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c8e26d8c00/0x63a04852f4628504 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788309411.631873:0:5830:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788309411.632947:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f4ce0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+12:3302:x1875178210474240:12345-0@lo:103: Request processed in 2346us (3030us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309411.632959:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788309411.633145:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8c89f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3302:1875178210474240:0@lo:103: 00000100:00100000:3.0:1788309411.718102:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+11:7621:x1875178210473472:12345-0@lo:253: Request processed in 131494us (132001us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309411.718132:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788309411.718256:0:7621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e667c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:7621:1875178210473472:0@lo:253: 10000000:01000000:1.0:1788309411.718308:0:7621:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788309411.718312:0:7621:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788309411.718313:0:7621:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788309411.718315:0:7621:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788309411.718316:0:7621:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1788309411.718317:0:7621:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788309411.718318:0:7621:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788309411.718319:0:7621:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788309411.718321:0:7621:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788309411.718323:0:7621:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788309411.718324:0:7621:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788309411.718344:0:7621:0:(tgt_mount.c:101:server_register_mount()) register mount ffff97c8f519c800 from lustre-OST0001 10000000:01000000:1.0:1788309411.718369:0:7621:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1788309411.718372:0:7621:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788309411.718380:0:7621:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff97c8e661b370 local copy 10000000:01000000:1.0:1788309411.718384:0:7621:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788309411.718418:0:7621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c9021e4c00/0x63a04852f462850b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309411.718429:0:7621:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.155@tcp lock: ffff97c9021e4c00/0x63a04852f462850b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309411.718437:0:7621:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff97c9021e4c00/0x63a04852f462850b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309411.718457:0:7621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8f4ce2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:7621:1875178210474880:0@lo:101: 00000100:00100000:1.0:1788309411.718494:0:7621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309411.718539:0:7621:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c3522000 going to sleep for 11 seconds 00000100:00100000:3.0:1788309411.718811:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210474880 00000100:00100000:3.0:1788309411.718818:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210474880 00000100:00100000:3.0:1788309411.718862:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788309411.718871:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+11:7621:x1875178210474880:12345-0@lo:101: 00010000:00010000:3.0:1788309411.718883:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309411.718897:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c8c153a600/0x63a04852f4628512 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x63a04852f462850b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309411.718919:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8c153a600/0x63a04852f4628512 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63a04852f462850b expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309411.718928:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c8c153a600/0x63a04852f4628512 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f462850b expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309411.718936:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8c153a600, rc 0) 00000100:00100000:3.0:1788309411.718967:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+12:7621:x1875178210474880:12345-0@lo:101: Request processed in 97us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309411.718973:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788309411.719150:0:7621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8f4ce2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:7621:1875178210474880:0@lo:101: 00010000:00010000:0.0:1788309411.719165:0:7621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff97c9021e4c00/0x63a04852f462850b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x63a04852f4628512 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309411.719184:0:7621:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff97c9021e4c00/0x63a04852f462850b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x63a04852f4628512 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309411.719324:0:7621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8c89fb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:7621:1875178210475008:0@lo:501: 00000100:00100000:0.0:1788309411.719351:0:7621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309411.719374:0:7621:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8ffb80180 going to sleep for 11 seconds 00000100:00100000:3.0:1788309411.719641:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210475008 00000100:00100000:3.0:1788309411.719646:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210475008 00000100:00100000:3.0:1788309411.719670:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788309411.719843:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6ae9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+12:7621:x1875178210475008:12345-0@lo:501: 00000100:00100000:3.0:1788309411.720081:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6ae9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+12:7621:x1875178210475008:12345-0@lo:501: Request processed in 240us (728us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788309411.720089:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788309411.720273:0:7621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8c89fb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:7621:1875178210475008:0@lo:501: 10000000:01000000:1.0:1788309411.720313:0:7621:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.155@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788309411.720344:0:7621:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.155@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788309411.720351:0:7621:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c9021e4c00/0x63a04852f462850b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x63a04852f4628512 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309411.720366:0:7621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c9021e4c00/0x63a04852f462850b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x63a04852f4628512 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309411.720373:0:7621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.155@tcp lock: ffff97c9021e4c00/0x63a04852f462850b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x63a04852f4628512 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309411.720394:0:7621:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788309411.720415:0:7621:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff97c8f519c800 10000000:01000000:1.0:1788309411.720419:0:7621:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788309411.720425:0:7621:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788309411.720427:0:7621:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788309411.720433:0:7621:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788309411.720436:0:7621:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788309411.720456:0:7621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c9021e4200/0x63a04852f4628519 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309411.720463:0:7621:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff97c9021e4200/0x63a04852f4628519 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309411.720471:0:7621:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff97c9021e4200/0x63a04852f4628519 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309411.720483:0:7621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8f4ce1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:7621:1875178210475136:0@lo:101: 00000100:00100000:1.0:1788309411.720512:0:7621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309411.720537:0:7621:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c35229c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788309411.720552:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210475136 00000100:00100000:1.0:1788309411.720556:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210475136 00000100:00100000:1.0:1788309411.720582:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788309411.720588:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+12:7621:x1875178210475136:12345-0@lo:101: 00010000:00010000:1.0:1788309411.720602:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788309411.720621:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c8f5549600/0x63a04852f4628520 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x63a04852f4628519 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309411.720639:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8f5549600/0x63a04852f4628520 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63a04852f4628519 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309411.720648:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c8f5549600/0x63a04852f4628520 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f4628519 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309411.720656:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8f5549600, rc 0) 00000100:00100000:1.0:1788309411.720697:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+13:7621:x1875178210475136:12345-0@lo:101: Request processed in 108us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309411.720765:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788309411.720798:0:7621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8f4ce1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:7621:1875178210475136:0@lo:101: 00010000:00010000:1.0:1788309411.720808:0:7621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff97c9021e4200/0x63a04852f4628519 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4628520 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309411.720816:0:7621:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff97c9021e4200/0x63a04852f4628519 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x63a04852f4628520 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309411.720876:0:7621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8f4ce1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:7621:1875178210475264:0@lo:501: 00000100:00100000:1.0:1788309411.720898:0:7621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309411.720910:0:7621:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c35229c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788309411.720921:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210475264 00000100:00100000:1.0:1788309411.720924:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210475264 00000100:00100000:1.0:1788309411.720938:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788309411.720943:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+13:7621:x1875178210475264:12345-0@lo:501: 00000100:00100000:1.0:1788309411.721117:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+13:7621:x1875178210475264:12345-0@lo:501: Request processed in 172us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309411.721123:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788309411.721151:0:7621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8f4ce1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:7621:1875178210475264:0@lo:501: 00000100:00100000:1.0:1788309411.721173:0:7621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8f4ce1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:7621:1875178210475392:0@lo:503: 00000100:00100000:1.0:1788309411.721344:0:7621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309411.721358:0:7621:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c35229c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788309411.721371:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210475392 00000100:00100000:1.0:1788309411.721375:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210475392 00000100:00100000:1.0:1788309411.721391:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788309411.721397:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+13:7621:x1875178210475392:12345-0@lo:503: 00000100:00100000:1.0:1788309411.721535:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+13:7621:x1875178210475392:12345-0@lo:503: Request processed in 137us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309411.721541:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788309411.721575:0:7621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8f4ce1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:7621:1875178210475392:0@lo:503: 00000040:00080000:1.0:1788309411.723424:0:7621:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788309411.723530:0:7621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8f4ce1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:7621:1875178210475520:0@lo:502: 00000100:00100000:1.0:1788309411.723598:0:7621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309411.723637:0:7621:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c35229c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788309411.723660:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210475520 00000100:00100000:1.0:1788309411.723665:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210475520 00010000:00010000:3.0:1788309411.723799:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788309411.723808:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff97c9021e4c00/0x63a04852f462850b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x63a04852f4628512 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309411.723824:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c9021e4c00 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:3.0:1788309411.723829:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff97c9021e4c00/0x63a04852f462850b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x63a04852f4628512 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309411.723838:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff97c9021e4c00/0x63a04852f462850b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x63a04852f4628512 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788309411.723843:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff97c9021e4c00/0x63a04852f462850b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x63a04852f4628512 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788309411.723848:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788309411.723872:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff97c9021e4c00/0x63a04852f462850b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x63a04852f4628512 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309411.723878:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788309411.723896:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff97c9021e4c00/0x63a04852f462850b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x63a04852f4628512 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309411.723903:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff97c9021e4c00/0x63a04852f462850b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x63a04852f4628512 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309411.723916:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309411.723918:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309411.723920:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788309411.724070:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788309411.724080:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+13:7621:x1875178210475520:12345-0@lo:502: 00000100:00100000:1.0:1788309411.724404:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+13:7621:x1875178210475520:12345-0@lo:502: Request processed in 324us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309411.724421:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788309411.724592:0:7621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8f4ce1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:7621:1875178210475520:0@lo:502: 00000040:00080000:3.0:1788309411.724898:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788309411.724955:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1788309411.724992:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1788309411.725058:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1788309411.725117:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1788309411.725154:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1788309411.725200:0:7621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e667c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:7621:1875178210475776:0@lo:502: 00000100:00100000:3.0:1788309411.725248:0:7621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309411.726032:0:7621:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8eff1e240 going to sleep for 11 seconds 00000100:00100000:2.0:1788309411.726166:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e667fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3300:1875178210475648:0@lo:103: 00000100:00100000:2.0:1788309411.726271:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309411.726420:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210475648 00000100:00100000:3.0:1788309411.726427:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210475648 00000100:00100000:3.0:1788309411.726475:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788309411.726483:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ec686680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+13:3300:x1875178210475648:12345-0@lo:103: 00010000:00010000:3.0:1788309411.726506:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788309411.726525:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c8c153a600/0x63a04852f4628512 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x63a04852f462850b expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309411.726543:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788309411.726579:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ec686680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+12:3300:x1875178210475648:12345-0@lo:103: Request processed in 97us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309411.726586:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788309411.726981:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210475776 00000100:00100000:0.0:1788309411.726986:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210475776 00000100:00100000:0.0:1788309411.727012:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788309411.727019:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+12:7621:x1875178210475776:12345-0@lo:502: 00000100:00100000:0.0:1788309411.727394:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+12:7621:x1875178210475776:12345-0@lo:502: Request processed in 374us (2144us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309411.727402:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788309411.727586:0:7621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e667c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:7621:1875178210475776:0@lo:502: 00000040:00080000:3.0:1788309411.727828:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1788309411.727844:0:7621:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000100:00100000:3.0:1788309411.728486:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e667fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3300:1875178210475648:0@lo:103: 00000020:01000000:1.0:1788309411.729825:0:7629:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788309411.729838:0:7629:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1788309411.729846:0:7629:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788309411.729849:0:7629:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788309411.729855:0:7629:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788309411.729878:0:7629:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff97c8eff4b370) 00000020:00000080:1.0:1788309411.729902:0:7629:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788309411.729908:0:7629:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788309411.729972:0:7629:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97c8f519c800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788309411.729979:0:7629:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788309411.729986:0:7629:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x63a04852f462852e 00010000:00010000:1.0:1788309411.737136:0:7629:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1788309411.737655:0:7629:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1788309411.743521:0:7629:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1788309411.743971:0:7629:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1788309411.759219:0:7629:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1788309411.760918:0:7629:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1788309411.763798:0:7629:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788309411.763810:0:7629:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788309411.763817:0:7629:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788309411.763819:0:7629:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788309411.763823:0:7629:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788309411.763827:0:7629:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788309411.763828:0:7629:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788309411.763831:0:7629:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788309411.763832:0:7629:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788309411.763886:0:7629:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788309411.763890:0:7629:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788309411.763891:0:7629:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788309411.763894:0:7629:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1788309411.766134:0:7621:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1788309411.766187:0:7621:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788309411.766208:0:7621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c9021e4200/0x63a04852f4628519 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4628520 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309411.766220:0:7621:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff97c9021e4200/0x63a04852f4628519 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4628520 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788309411.766228:0:7621:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97c8f519c800 from 1 10000000:01000000:0.0:1788309411.766231:0:7621:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788309411.766269:0:7621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8d73eea00/0x63a04852f4628535 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309411.766303:0:7621:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff97c8d73eea00/0x63a04852f4628535 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309411.766316:0:7621:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff97c8d73eea00/0x63a04852f4628535 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309411.766340:0:7621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8c89f8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:7621:1875178210475904:0@lo:101: 00000100:00100000:0.0:1788309411.766409:0:7621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309411.766450:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210475904 00000100:00100000:0.0:1788309411.766458:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210475904 00000100:00100000:0.0:1788309411.766505:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788309411.766514:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+12:7621:x1875178210475904:12345-0@lo:101: 00010000:00010000:0.0:1788309411.766526:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788309411.766539:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c8d73efe00/0x63a04852f462853c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x63a04852f4628535 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309411.766572:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8d73efe00/0x63a04852f462853c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63a04852f4628535 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309411.766582:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c8d73efe00/0x63a04852f462853c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f4628535 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309411.766590:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8d73efe00, rc 0) 00000100:00100000:0.0:1788309411.766626:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+13:7621:x1875178210475904:12345-0@lo:101: Request processed in 113us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309411.766633:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788309411.766694:0:7621:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8ffb80000 going to sleep for 11 seconds 00000100:00100000:0.0:1788309411.766732:0:7621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8c89f8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:7621:1875178210475904:0@lo:101: 00010000:00010000:0.0:1788309411.766746:0:7621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff97c8d73eea00/0x63a04852f4628535 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f462853c expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309411.766754:0:7621:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff97c8d73eea00/0x63a04852f4628535 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x63a04852f462853c expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309411.766849:0:7621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8c89f8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:7621:1875178210476032:0@lo:501: 00000100:00100000:0.0:1788309411.766873:0:7621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309411.766887:0:7621:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8ffb80000 going to sleep for 11 seconds 00000100:00100000:2.0:1788309411.767871:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210476032 00000100:00100000:2.0:1788309411.767879:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210476032 00000100:00100000:2.0:1788309411.767917:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788309411.767925:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+13:7621:x1875178210476032:12345-0@lo:501: 00000100:00100000:2.0:1788309411.768194:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+13:7621:x1875178210476032:12345-0@lo:501: Request processed in 269us (1319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309411.768201:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788309411.768234:0:7621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8c89f8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:7621:1875178210476032:0@lo:501: 00000100:00100000:2.0:1788309411.768497:0:7621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ec685c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:7621:1875178210476160:0@lo:503: 00000100:00100000:2.0:1788309411.768541:0:7621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309411.768571:0:7621:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8e0684480 going to sleep for 11 seconds 00000100:00100000:2.0:1788309411.768589:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210476160 00000100:00100000:2.0:1788309411.768598:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210476160 00000100:00100000:2.0:1788309411.768624:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788309411.768631:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+13:7621:x1875178210476160:12345-0@lo:503: 00000100:00100000:2.0:1788309411.769508:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+13:7621:x1875178210476160:12345-0@lo:503: Request processed in 874us (963us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309411.769516:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788309411.771926:0:7621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ec685c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:7621:1875178210476160:0@lo:503: 00000040:00080000:0.0:1788309411.772684:0:7621:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788309411.772802:0:7621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8c89fb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:7621:1875178210476288:0@lo:502: 00000100:00100000:0.0:1788309411.772870:0:7621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309411.773582:0:7621:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8ffb80240 going to sleep for 11 seconds 00000100:00100000:3.0:1788309411.780150:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210476288 00000100:00100000:3.0:1788309411.780168:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210476288 00000100:00100000:3.0:1788309411.781137:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788309411.781154:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+13:7621:x1875178210476288:12345-0@lo:502: 00000100:00100000:1.0:1788309411.781826:0:7621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8c89fb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:7621:1875178210476288:0@lo:502: 00000040:00080000:1.0:1788309411.782146:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1788309411.782204:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1788309411.782244:0:7621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8f4ce1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:7621:1875178210476416:0@lo:502: 00000100:00100000:1.0:1788309411.782332:0:7621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309411.783104:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+13:7621:x1875178210476288:12345-0@lo:502: Request processed in 561us (8838us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309411.783116:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788309411.793833:0:7621:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c3522b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788309411.793999:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210476416 00000100:00100000:3.0:1788309411.794009:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210476416 00000100:00100000:3.0:1788309411.794063:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788309411.794075:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+13:7621:x1875178210476416:12345-0@lo:502: 00000100:00100000:3.0:1788309411.794396:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+13:7621:x1875178210476416:12345-0@lo:502: Request processed in 322us (12063us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309411.794405:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788309411.794755:0:7621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8f4ce1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:7621:1875178210476416:0@lo:502: 00000040:00080000:1.0:1788309411.794908:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1788309411.794924:0:7621:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1788309411.797365:0:7633:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788309411.797380:0:7633:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788309411.797382:0:7633:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788309411.797538:0:7633:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97c8f519c800 00000020:00000080:3.0:1788309411.797542:0:7633:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788309411.797572:0:7633:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788309411.797576:0:7633:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788309411.797577:0:7633:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788309411.797580:0:7633:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1788309411.797733:0:7621:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788309411.797757:0:7621:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788309411.797779:0:7621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8d73eea00/0x63a04852f4628535 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f462853c expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309411.797791:0:7621:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff97c8d73eea00/0x63a04852f4628535 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f462853c expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788309411.797836:0:7621:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788309411.797839:0:7621:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff97c8f519c800 10000000:01000000:1.0:1788309411.797842:0:7621:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff97c8f519c800 10000000:01000000:1.0:1788309411.797846:0:7621:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788309411.797851:0:7621:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97c8f519c800 from 1 10000000:01000000:1.0:1788309411.797854:0:7621:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788309411.797888:0:7621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8f5548000/0x63a04852f4628543 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309411.797897:0:7621:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff97c8f5548000/0x63a04852f4628543 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309411.797908:0:7621:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff97c8f5548000/0x63a04852f4628543 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309411.797929:0:7621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8f4ce1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:7621:1875178210476544:0@lo:101: 00000100:00100000:1.0:1788309411.797991:0:7621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309411.798045:0:7621:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c3522b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788309411.798254:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210476544 00000100:00100000:3.0:1788309411.798262:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210476544 00000100:00100000:3.0:1788309411.798338:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788309411.798348:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+13:7621:x1875178210476544:12345-0@lo:101: 00010000:00010000:3.0:1788309411.798374:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309411.798388:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c8c153a600/0x63a04852f462854a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x63a04852f4628543 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309411.798409:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8c153a600/0x63a04852f462854a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63a04852f4628543 expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309411.798419:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c8c153a600/0x63a04852f462854a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f4628543 expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309411.798428:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8c153a600, rc 0) 00000100:00100000:3.0:1788309411.798469:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+14:7621:x1875178210476544:12345-0@lo:101: Request processed in 123us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309411.798487:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788309411.799158:0:7621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8f4ce1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:7621:1875178210476544:0@lo:101: 00010000:00010000:1.0:1788309411.799184:0:7621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff97c8f5548000/0x63a04852f4628543 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f462854a expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309411.799194:0:7621:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff97c8f5548000/0x63a04852f4628543 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x63a04852f462854a expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309411.799311:0:7621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8f4ce1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:7621:1875178210476672:0@lo:501: 00000100:00100000:1.0:1788309411.799341:0:7621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309411.799560:0:7621:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c3522b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788309411.799643:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210476672 00000100:00100000:2.0:1788309411.799648:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210476672 00000100:00100000:2.0:1788309411.799692:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788309411.799700:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+14:7621:x1875178210476672:12345-0@lo:501: 00000100:00100000:2.0:1788309411.799944:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+14:7621:x1875178210476672:12345-0@lo:501: Request processed in 244us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309411.799951:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788309411.800300:0:7621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8f4ce1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:7621:1875178210476672:0@lo:501: 00000100:00100000:1.0:1788309411.800335:0:7621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8f4ce1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:7621:1875178210476800:0@lo:503: 00000100:00100000:1.0:1788309411.800933:0:7621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309411.800966:0:7621:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c3522b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788309411.801859:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210476800 00000100:00100000:0.0:1788309411.801870:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210476800 00000100:00100000:0.0:1788309411.802018:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788309411.802038:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+14:7621:x1875178210476800:12345-0@lo:503: 00000100:00100000:0.0:1788309411.802270:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+14:7621:x1875178210476800:12345-0@lo:503: Request processed in 226us (1328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309411.802297:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788309411.802397:0:7621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8f4ce1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:7621:1875178210476800:0@lo:503: 00000040:00080000:1.0:1788309411.802670:0:7621:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788309411.804907:0:7621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8f4ce1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:7621:1875178210476928:0@lo:502: 00000100:00100000:1.0:1788309411.804992:0:7621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309411.816875:0:7621:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c3522b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788309411.821554:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210476928 00000100:00100000:3.0:1788309411.821572:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210476928 00000100:00100000:3.0:1788309411.821659:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788309411.821682:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+14:7621:x1875178210476928:12345-0@lo:502: 00000100:00100000:3.0:1788309411.822552:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+14:7621:x1875178210476928:12345-0@lo:502: Request processed in 881us (17556us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309411.822562:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788309411.830961:0:7621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8f4ce1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:7621:1875178210476928:0@lo:502: 00000040:00080000:1.0:1788309411.831431:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1788309411.831494:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1788309411.831530:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1788309411.831586:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1788309411.832162:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1788309411.832320:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1788309411.832427:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1788309411.832464:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1788309411.832510:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1788309411.832545:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1788309411.832573:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1788309411.832613:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1788309411.832917:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1788309411.832954:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1788309411.833005:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1788309411.833490:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1788309411.833534:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1788309411.833587:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1788309411.833638:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1788309411.833908:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1788309411.833970:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1788309411.834005:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1788309411.834127:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1788309411.834645:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1788309411.838838:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1788309411.838954:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1788309411.840002:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1788309411.840143:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:1.0:1788309411.840567:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1788309411.840650:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:1.0:1788309411.840790:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:1.0:1788309411.840830:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:1.0:1788309411.840865:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:1.0:1788309411.840918:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:1.0:1788309411.840957:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:1.0:1788309411.841004:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:1.0:1788309411.841056:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:1.0:1788309411.841111:0:7621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8f4ce1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:7621:1875178210477056:0@lo:502: 00000100:00100000:1.0:1788309411.841214:0:7621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309411.841306:0:7621:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c3522b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788309411.841565:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210477056 00000100:00100000:0.0:1788309411.841574:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210477056 00000100:00100000:0.0:1788309411.841621:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788309411.841632:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+14:7621:x1875178210477056:12345-0@lo:502: 00000100:00100000:0.0:1788309411.841880:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+14:7621:x1875178210477056:12345-0@lo:502: Request processed in 249us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309411.841888:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788309411.843871:0:7621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8f4ce1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:7621:1875178210477056:0@lo:502: 00000040:00080000:1.0:1788309411.844032:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:1.0:1788309411.844050:0:7621:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1788309411.848594:0:7634:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788309411.848630:0:7634:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff97c8ecf799b8) 00000020:00000080:1.0:1788309411.848656:0:7634:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:1.0:1788309411.848837:0:7634:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97c8f519c800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788309411.848842:0:7634:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97c8f519c800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788309411.848845:0:7634:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97c8f519c800 3 00010000:00080000:1.0:1788309411.848880:0:7634:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97c8fc782800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.155@tcp at head 00010000:00010000:1.0:1788309411.854136:0:7634:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:1.0:1788309411.854916:0:7634:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788309411.854957:0:7634:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788309411.854969:0:7634:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x63a04852f4628558 00000100:00080000:1.0:1788309411.854979:0:7634:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788309411.854986:0:7634:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff97c8fc782800 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:1.0:1788309411.855607:0:7634:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97c8f4ce1180 x1875178210477184/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788309411.861914:0:7634:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788309411.862343:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8f4ce1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3299:1875178210477184:0@lo:38: 00000100:00100000:2.0:1788309411.862426:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309411.862517:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210477184 00000100:00100000:0.0:1788309411.862526:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210477184 00000100:00100000:0.0:1788309411.862572:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788309411.862581:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ec685c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3299:x1875178210477184:12345-0@lo:38: 00010000:00080000:0.0:1788309411.862613:0:5837:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 174 last 0 00000020:00000080:0.0:1788309411.862650:0:5837:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x63a04852f462855f 00000004:00100000:0.0:1788309411.862666:0:5837:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788309411.862724:0:5837:0:(import.c:65:import_set_state_nolock()) ffff97c8ee5cf000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788309411.862777:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ec685c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1875178210477184:12345-0@lo:38: Request processed in 195us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309411.862784:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788309411.862829:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97c8f4ce1180 x1875178210477184/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788309421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788309411.862842:0:3299:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788309411.862850:0:3299:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1788309411.862858:0:3299:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788309411.862863:0:3299:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788309411.862865:0:3299:0:(import.c:65:import_set_state_nolock()) ffff97c8fc782800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788309411.862871:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8f4ce1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3299:1875178210477184:0@lo:38: 00000040:00080000:1.0:1788309411.863169:0:7634:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:2.0:1788309411.863712:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ec687100 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7636:1875178210477312:0@lo:901: 00000100:00100000:2.0:1788309411.863762:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309411.863794:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8e0684c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788309411.863846:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210477312 00000100:00100000:1.0:1788309411.863851:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210477312 00000100:00100000:1.0:1788309411.863901:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788309411.863909:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ec684000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7636:x1875178210477312:12345-0@lo:901: 00000100:00080000:2.0:1788309411.863946:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:01000000:0.0:1788309411.865305:0:7621:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1788309411.865350:0:7621:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788309411.865372:0:7621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8f5548000/0x63a04852f4628543 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f462854a expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309411.865383:0:7621:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff97c8f5548000/0x63a04852f4628543 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f462854a expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788309411.865428:0:7621:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788309411.865430:0:7621:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788309411.865431:0:7621:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788309411.865432:0:7621:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788309411.865433:0:7621:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788309411.865434:0:7621:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788309411.865435:0:7621:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788309411.865437:0:7621:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788309411.865438:0:7621:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788309411.865440:0:7621:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788309411.865441:0:7621:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788309411.865445:0:7621:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1788309411.865447:0:7621:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788309411.865448:0:7621:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788309411.865450:0:7621:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788309411.865451:0:7621:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788309411.865452:0:7621:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788309411.865453:0:7621:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788309411.865454:0:7621:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788309411.865455:0:7621:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788309411.865456:0:7621:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788309411.865457:0:7621:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788309411.865458:0:7621:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788309411.865476:0:7621:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788309411.865490:0:7621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8c89fa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:7621:1875178210477440:0@lo:253: 00000100:00100000:0.0:1788309411.865542:0:7621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309411.865577:0:7621:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8ffb80240 going to sleep for 11 seconds 00000100:00100000:0.0:1788309411.865598:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210477440 00000100:00100000:0.0:1788309411.865604:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210477440 00000100:00100000:0.0:1788309411.865689:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788309411.865698:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+14:7621:x1875178210477440:12345-0@lo:253: 20000000:01000000:0.0:1788309411.866263:0:5830:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:1.0:1788309411.866397:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ec684000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7636:x1875178210477312:12345-0@lo:901: Request processed in 2487us (2633us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309411.866408:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 20000000:01000000:0.0:1788309411.866636:0:5830:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:2.0:1788309411.866788:0:7636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97c8ec687100 x1875178210477312/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788309427 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788309411.866804:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ec687100 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7636:1875178210477312:0@lo:901: 20000000:01000000:0.0:1788309411.904996:0:5830:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788309411.905021:0:5830:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788309411.905106:0:5853:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788309411.905113:0:5853:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788309411.905137:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97c8e26d8000/0x63a04852f4628566 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309411.905157:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c8d73ef000/0x63a04852f46284b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f46284b0 expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309411.905165:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97c8e26d8000/0x63a04852f4628566 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309411.905223:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c8d73ef000/0x63a04852f46284b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x63a04852f46284b0 expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309411.905237:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97c8d73ef000/0x63a04852f46284b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x63a04852f46284b0 expref: 14 pid: 5831 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309411.905253:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ec687100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5853:1875178210477568:0@lo:104: 00000100:00100000:2.0:1788309411.905352:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309411.905393:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8e0684300 going to sleep for 11 seconds 00000100:00100000:2.0:1788309411.905414:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210477568 00000100:00100000:2.0:1788309411.905421:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210477568 00000100:00100000:2.0:1788309411.905466:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788309411.905476:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ec684380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+3:5853:x1875178210477568:12345-0@lo:104: 00010000:00010000:2.0:1788309411.905502:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff97c8c153a000/0x63a04852f46284b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x63a04852f46284b7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309411.905551:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788309411.905558:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ec684380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+3:5853:x1875178210477568:12345-0@lo:104: Request processed in 84us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309411.905565:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1788309411.905590:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788309411.905596:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff97c8c153a000/0x63a04852f46284b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x63a04852f46284b7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309411.905603:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8c153a000 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:2.0:1788309411.905607:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff97c8c153a000/0x63a04852f46284b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x63a04852f46284b7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309411.905617:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff97c8c153a000/0x63a04852f46284b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x63a04852f46284b7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788309411.905624:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff97c8c153a000/0x63a04852f46284b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x63a04852f46284b7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788309411.905630:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788309411.905687:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff97c8c153a000/0x63a04852f46284b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f46284b7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309411.905694:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788309411.905852:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff97c8c153a000/0x63a04852f46284b0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f46284b7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309411.905861:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff97c8c153a000/0x63a04852f46284b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f46284b7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309411.905887:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309411.905889:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309411.905891:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788309411.905916:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecf14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3301:1875178210477696:0@lo:103: 00000100:00100000:2.0:1788309411.905948:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309411.905985:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210477696 00000100:00100000:2.0:1788309411.905989:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210477696 00010000:00010000:2.0:1788309411.906007:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c8d73ef000/0x63a04852f46284b7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63a04852f46284b0 expref: 15 pid: 5831 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309411.906161:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788309411.906222:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6b28850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+15:3301:x1875178210477696:12345-0@lo:103: 00010000:00010000:2.0:1788309411.906235:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788309411.906241:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c8d73ef000/0x63a04852f46284b7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63a04852f46284b0 expref: 15 pid: 5831 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309411.906252:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c8d73ef000/0x63a04852f46284b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x63a04852f46284b0 expref: 15 pid: 5831 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309411.906446:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97c8e26d8000/0x63a04852f4628566 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309411.906455:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8e26d8000/0x63a04852f4628566 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788309411.906469:0:5823:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003944353s 00010000:00010000:2.0:1788309411.906473:0:5823:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97c8e26d8000/0x63a04852f4628566 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309411.906491:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97c8e26d8000/0x63a04852f4628566 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309411.906498:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97c8e26d8000/0x63a04852f4628566 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309411.906504:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97c8e26d8000/0x63a04852f4628566 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309411.906510:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d8000 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:2.0:1788309411.906513:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97c8e26d8000/0x63a04852f4628566 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309411.906521:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97c8e26d8000/0x63a04852f4628566 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309411.906530:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97c8e26d8000/0x63a04852f4628566 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309411.906540:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788309411.906574:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6b28850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+15:3301:x1875178210477696:12345-0@lo:103: Request processed in 406us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309411.906581:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788309411.906640:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecf14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3301:1875178210477696:0@lo:103: 00010000:00010000:2.0:1788309411.906664:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c8d73ef000/0x63a04852f46284b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x63a04852f46284b0 expref: 14 pid: 5831 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309411.906687:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ec687100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5853:1875178210477568:0@lo:104: 00010000:00010000:2.0:1788309411.906698:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97c8e26d8000/0x63a04852f4628566 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309411.906923:0:5853:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97c8e26d8000/0x63a04852f4628566 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309411.906930:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97c8e26d8000/0x63a04852f4628566 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309411.906937:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c8e26d8000/0x63a04852f4628566 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309411.918894:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+13:7621:x1875178210477440:12345-0@lo:253: Request processed in 53186us (53340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309411.918910:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788309411.919005:0:7621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8c89fa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:00707c3b-bc67-4313-a42d-1f5d185ea5d5:7621:1875178210477440:0@lo:253: 10000000:01000000:0.0:1788309411.919020:0:7621:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788309411.919089:0:7621:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788309411.919092:0:7621:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788309411.919094:0:7621:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788309411.919095:0:7621:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788309411.919097:0:7621:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788309411.919098:0:7621:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788309411.919099:0:7621:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788309411.919101:0:7621:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788309411.919102:0:7621:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788309411.919104:0:7621:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788309411.919105:0:7621:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788309411.919120:0:7621:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788309411.928885:0:7621:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788309411.929243:0:7621:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788309411.929558:0:7621:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788309411.929867:0:7621:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788309411.930149:0:7621:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788309411.930653:0:7621:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788309411.933007:0:7621:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1788309412.139926:0:7621:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1788309412.139933:0:7621:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1788309412.139964:0:7621:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788309412.140090:0:7621:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.155@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788309412.140106:0:7621:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788309412.140135:0:7621:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1788309412.577856:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309413.600708:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309414.625993:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309415.649373:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788309416.427247:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788309416.427273:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8c89fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210477824:0@lo:13: 00000100:00100000:2.0:1788309416.430463:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309416.430563:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210477824 00000100:00100000:2.0:1788309416.430573:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210477824 00000100:00100000:2.0:1788309416.430663:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788309416.430676:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecf14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210477824:12345-0@lo:13: 00002000:00000024:2.0:1788309416.430719:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788309416.430762:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecf14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210477824:12345-0@lo:13: Request processed in 91us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309416.430767:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1788309416.430786:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788309416.430818:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8c89fa300 x1875178210477824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788309432 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788309416.430841:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8c89fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210477824:0@lo:13: 00010000:00010000:2.0:1788309416.676479:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788309416.928553:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8c89fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875178210478336:0@lo:400: 00000100:00100000:0.0:1788309416.928641:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309416.928700:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788309416.928707:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8c89f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3302:1875178210477952:0@lo:400: 00000100:00100000:0.0:1788309416.928737:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309416.928769:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8c89f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875178210478080:0@lo:400: 00000100:00100000:0.0:1788309416.928792:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309416.928809:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788309416.928814:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8c89f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875178210478208:0@lo:400: 00000100:00100000:0.0:1788309416.928846:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309416.928878:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210478336 00000100:00100000:0.0:1788309416.928885:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210478336 00000100:00100000:0.0:1788309416.928929:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210478080 00000100:00100000:0.0:1788309416.928932:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210478080 00000100:00100000:0.0:1788309416.928946:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210478208 00000100:00100000:0.0:1788309416.928948:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210478208 00000100:00100000:0.0:1788309416.928965:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788309416.928975:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c89fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875178210478336:12345-0@lo:400: 00000100:00100000:0.0:1788309416.930087:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c89fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875178210478336:12345-0@lo:400: Request processed in 1107us (1440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309416.930098:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788309416.930123:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788309416.930132:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c89fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875178210478080:12345-0@lo:400: 00000100:00100000:0.0:1788309416.930173:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c89fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875178210478080:12345-0@lo:400: Request processed in 43us (1380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309416.930179:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788309416.930190:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788309416.930198:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c89f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875178210478208:12345-0@lo:400: 00000100:00100000:0.0:1788309416.930240:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c89f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875178210478208:12345-0@lo:400: Request processed in 43us (1394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309416.930247:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788309416.930268:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210477952 00000100:00100000:0.0:1788309416.930274:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210477952 00000100:00100000:0.0:1788309416.930319:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788309416.930325:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+13:3302:x1875178210477952:12345-0@lo:400: 00000100:00100000:0.0:1788309416.930355:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+13:3302:x1875178210477952:12345-0@lo:400: Request processed in 31us (1617us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309416.930371:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:0.0:1788309416.930404:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788309416.930748:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8c89f8000 x1875178210478208/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309432 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788309416.930765:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8c89f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875178210478208:0@lo:400: 00010000:00080000:0.0:1788309416.930777:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8c89f9180 x1875178210478080/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309432 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788309416.930790:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8c89f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875178210478080:0@lo:400: 00000100:00100000:0.0:1788309416.931040:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8c89f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3302:1875178210477952:0@lo:400: 00010000:00080000:0.0:1788309416.931052:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8c89fbb80 x1875178210478336/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309432 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788309416.931061:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8c89fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875178210478336:0@lo:400: 00010000:00010000:2.0:1788309417.709143:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788309418.232629:0:7978:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg255-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788309418.720487:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309419.757109:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788309420.512626:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788309420.512642:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97c8d6805000 from 30 10000000:01000000:2.0:1788309420.512647:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788309420.512696:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8c00/0x63a04852f462856d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309420.512708:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8c00/0x63a04852f462856d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309420.512721:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8c00/0x63a04852f462856d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309420.512747:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecf17100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210478464:0@lo:101: 00000100:00100000:2.0:1788309420.512824:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309420.512879:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c378ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1788309420.513137:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210478464 00000100:00100000:3.0:1788309420.513145:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210478464 00000100:00100000:3.0:1788309420.513199:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788309420.513210:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+13:5834:x1875178210478464:12345-0@lo:101: 00010000:00010000:3.0:1788309420.513225:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309420.513237:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c8c153b200/0x63a04852f4628574 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x63a04852f462856d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309420.513260:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8c153b200/0x63a04852f4628574 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63a04852f462856d expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309420.513270:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c8c153b200/0x63a04852f4628574 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f462856d expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309420.513298:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8c153b200, rc 0) 00000100:00100000:3.0:1788309420.513369:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+14:5834:x1875178210478464:12345-0@lo:101: Request processed in 160us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309420.513377:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788309420.514591:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecf17100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210478464:0@lo:101: 00010000:00010000:2.0:1788309420.514623:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8c00/0x63a04852f462856d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4628574 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309420.514643:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8c00/0x63a04852f462856d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x63a04852f4628574 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309420.514716:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecf17100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210478592:0@lo:501: 00000100:00100000:2.0:1788309420.514776:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309420.514809:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c378ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1788309420.514840:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210478592 00000100:00100000:2.0:1788309420.514846:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210478592 00000100:00100000:2.0:1788309420.514881:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788309420.514890:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+14:5834:x1875178210478592:12345-0@lo:501: 00000100:00100000:2.0:1788309420.515224:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+14:5834:x1875178210478592:12345-0@lo:501: Request processed in 334us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309420.515233:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788309420.515251:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecf17100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210478592:0@lo:501: 00000100:00100000:1.0:1788309420.515306:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8f4ce1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210478720:0@lo:503: 00000100:00100000:1.0:1788309420.515348:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309420.515371:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c3522cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788309420.515720:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210478720 00000100:00100000:2.0:1788309420.515725:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210478720 00000100:00100000:2.0:1788309420.515753:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788309420.515760:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+14:5834:x1875178210478720:12345-0@lo:503: 00000100:00100000:2.0:1788309420.516022:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+14:5834:x1875178210478720:12345-0@lo:503: Request processed in 262us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309420.516029:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788309420.516050:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8f4ce1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210478720:0@lo:503: 00000100:00100000:2.0:1788309420.519189:0:8083:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecf16d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:8083:1875178210478848:0@lo:502: 00000100:00100000:2.0:1788309420.519307:0:8083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309420.519353:0:8083:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c378aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788309420.519367:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210478848 00000100:00100000:1.0:1788309420.519375:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210478848 00000100:00100000:1.0:1788309420.519431:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788309420.519441:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+14:8083:x1875178210478848:12345-0@lo:502: 00000100:00100000:1.0:1788309420.519799:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+14:8083:x1875178210478848:12345-0@lo:502: Request processed in 358us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309420.519808:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788309420.520092:0:8083:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecf16d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:8083:1875178210478848:0@lo:502: 00000100:00100000:2.0:1788309420.520135:0:8083:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecf16d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:8083:1875178210478976:0@lo:502: 00000100:00100000:2.0:1788309420.520159:0:8083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309420.520187:0:8083:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c378aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788309420.520833:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210478976 00000100:00100000:1.0:1788309420.520839:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210478976 00000100:00100000:1.0:1788309420.520939:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788309420.520950:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+14:8083:x1875178210478976:12345-0@lo:502: 00000100:00100000:1.0:1788309420.521152:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+14:8083:x1875178210478976:12345-0@lo:502: Request processed in 204us (990us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309420.521159:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788309420.521198:0:8083:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecf16d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:8083:1875178210478976:0@lo:502: 00000040:00080000:2.0:1788309420.521224:0:8083:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1788309420.521499:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1788309420.522019:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788309420.522029:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8c00/0x63a04852f462856d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4628574 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309420.522038:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8c00/0x63a04852f462856d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4628574 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788309420.522046:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788309420.522047:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1788309420.522049:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788309420.522075:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8e26d9600/0x63a04852f462857b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309420.522080:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff97c8e26d9600/0x63a04852f462857b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309420.522087:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff97c8e26d9600/0x63a04852f462857b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309420.522099:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecf16d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210479104:0@lo:101: 00000100:00100000:2.0:1788309420.522131:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309420.522161:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c378aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788309420.522184:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210479104 00000100:00100000:1.0:1788309420.522190:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210479104 00000100:00100000:1.0:1788309420.522259:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788309420.522267:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+14:5834:x1875178210479104:12345-0@lo:101: 00010000:00010000:1.0:1788309420.522293:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788309420.522307:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c8f5548c00/0x63a04852f4628582 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x63a04852f462857b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309420.522329:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8f5548c00/0x63a04852f4628582 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63a04852f462857b expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309420.522340:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c8f5548c00/0x63a04852f4628582 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f462857b expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309420.522362:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8f5548c00, rc 0) 00000100:00100000:1.0:1788309420.522400:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+15:5834:x1875178210479104:12345-0@lo:101: Request processed in 133us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309420.522405:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788309420.522743:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecf16d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210479104:0@lo:101: 00010000:00010000:2.0:1788309420.522757:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff97c8e26d9600/0x63a04852f462857b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4628582 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309420.522767:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff97c8e26d9600/0x63a04852f462857b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x63a04852f4628582 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309420.522815:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecf16d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210479232:0@lo:501: 00000100:00100000:2.0:1788309420.522849:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309420.522876:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c378aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788309420.523006:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210479232 00000100:00100000:1.0:1788309420.523010:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210479232 00000100:00100000:1.0:1788309420.523073:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788309420.523081:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+15:5834:x1875178210479232:12345-0@lo:501: 00000100:00100000:1.0:1788309420.523366:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+15:5834:x1875178210479232:12345-0@lo:501: Request processed in 285us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309420.523374:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788309420.523450:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecf16d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210479232:0@lo:501: 00000100:00100000:2.0:1788309420.523477:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecf16d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210479360:0@lo:503: 00000100:00100000:2.0:1788309420.523516:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309420.526155:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c378aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788309420.526386:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210479360 00000100:00100000:0.0:1788309420.526399:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210479360 00000100:00100000:0.0:1788309420.526458:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788309420.526469:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+15:5834:x1875178210479360:12345-0@lo:503: 00000100:00100000:0.0:1788309420.534654:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+15:5834:x1875178210479360:12345-0@lo:503: Request processed in 8174us (11125us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309420.534669:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788309420.536462:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecf16d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210479360:0@lo:503: 00000100:00100000:0.0:1788309420.538254:0:8084:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8c89fbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:8084:1875178210479488:0@lo:502: 00000100:00100000:0.0:1788309420.538478:0:8084:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309420.538572:0:8084:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d3a5e900 going to sleep for 11 seconds 00000100:00100000:1.0:1788309420.539816:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210479488 00000100:00100000:1.0:1788309420.539830:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210479488 00000100:00100000:1.0:1788309420.540024:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788309420.540037:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+15:8084:x1875178210479488:12345-0@lo:502: 00000100:00100000:1.0:1788309420.540422:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+15:8084:x1875178210479488:12345-0@lo:502: Request processed in 387us (1944us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309420.540429:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788309420.540523:0:8084:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8c89fbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:8084:1875178210479488:0@lo:502: 00000020:01000000:0.0:1788309420.540555:0:8084:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788309420.540564:0:8084:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788309420.540566:0:8084:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788309420.540571:0:8084:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788309420.540573:0:8084:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788309420.540612:0:8084:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8c89fbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:8084:1875178210479616:0@lo:502: 00000100:00100000:0.0:1788309420.540653:0:8084:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309420.542007:0:8084:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d3a5e900 going to sleep for 11 seconds 00000100:00100000:3.0:1788309420.542141:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210479616 00000100:00100000:3.0:1788309420.542150:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210479616 00000100:00100000:2.0:1788309420.542207:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788309420.542222:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+15:8084:x1875178210479616:12345-0@lo:502: 00000100:00100000:2.0:1788309420.542501:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+15:8084:x1875178210479616:12345-0@lo:502: Request processed in 281us (1845us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309420.542510:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788309420.542763:0:8084:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8c89fbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:8084:1875178210479616:0@lo:502: 00000020:01000000:0.0:1788309420.542795:0:8084:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788309420.542803:0:8084:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788309420.542806:0:8084:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788309420.542810:0:8084:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:2.0:1788309420.549897:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1788309420.549942:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788309420.549956:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8e26d9600/0x63a04852f462857b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4628582 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309420.550032:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff97c8e26d9600/0x63a04852f462857b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4628582 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788309420.550046:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788309420.550050:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97c8e07b1000 from 30 10000000:01000000:2.0:1788309420.550053:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788309420.550114:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8000/0x63a04852f4628589 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309420.550124:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8000/0x63a04852f4628589 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309420.550158:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8000/0x63a04852f4628589 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309420.550190:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecf16d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210479744:0@lo:101: 00000100:00100000:2.0:1788309420.554703:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309420.556044:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c378af00 going to sleep for 11 seconds 00000100:00100000:3.0:1788309420.556216:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210479744 00000100:00100000:3.0:1788309420.556227:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210479744 00000100:00100000:2.0:1788309420.559203:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788309420.559233:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+15:5834:x1875178210479744:12345-0@lo:101: 00010000:00010000:2.0:1788309420.559254:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309420.559302:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c8e26d8200/0x63a04852f4628590 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x63a04852f4628589 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309420.559335:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8e26d8200/0x63a04852f4628590 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63a04852f4628589 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309420.559347:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c8e26d8200/0x63a04852f4628590 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f4628589 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309420.559358:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8e26d8200, rc 0) 00000100:00100000:2.0:1788309420.559468:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+16:5834:x1875178210479744:12345-0@lo:101: Request processed in 251us (9191us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309420.559476:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788309420.559975:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecf16d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210479744:0@lo:101: 00010000:00010000:2.0:1788309420.559996:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8000/0x63a04852f4628589 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4628590 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309420.560007:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8000/0x63a04852f4628589 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x63a04852f4628590 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309420.560108:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecf16d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210479872:0@lo:501: 00000100:00100000:2.0:1788309420.560144:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309420.560185:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c378af00 going to sleep for 11 seconds 00000100:00100000:0.0:1788309420.560318:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210479872 00000100:00100000:0.0:1788309420.560326:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210479872 00000100:00100000:0.0:1788309420.560355:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788309420.560362:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+16:5834:x1875178210479872:12345-0@lo:501: 00000100:00100000:0.0:1788309420.560662:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+16:5834:x1875178210479872:12345-0@lo:501: Request processed in 299us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309420.560669:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788309420.560882:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecf16d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210479872:0@lo:501: 00000100:00100000:2.0:1788309420.560910:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecf16d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210480000:0@lo:503: 00000100:00100000:2.0:1788309420.560959:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309420.560976:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c378af00 going to sleep for 11 seconds 00000100:00100000:0.0:1788309420.561056:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210480000 00000100:00100000:0.0:1788309420.561060:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210480000 00000100:00100000:0.0:1788309420.561076:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788309420.561082:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+16:5834:x1875178210480000:12345-0@lo:503: 00000100:00100000:0.0:1788309420.561226:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+16:5834:x1875178210480000:12345-0@lo:503: Request processed in 144us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309420.561233:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788309420.561547:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecf16d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210480000:0@lo:503: 00000100:00100000:0.0:1788309420.561802:0:8085:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8c89fbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:8085:1875178210480128:0@lo:502: 00000100:00100000:0.0:1788309420.561838:0:8085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309420.561860:0:8085:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d3a5ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1788309420.561902:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210480128 00000100:00100000:2.0:1788309420.561906:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210480128 00000100:00100000:2.0:1788309420.562108:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788309420.562117:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+16:8085:x1875178210480128:12345-0@lo:502: 00000100:00100000:2.0:1788309420.562666:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+16:8085:x1875178210480128:12345-0@lo:502: Request processed in 549us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309420.562674:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788309420.562770:0:8085:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8c89fbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:8085:1875178210480128:0@lo:502: 00000100:00100000:1.0:1788309420.562852:0:8085:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8f4ce1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:8085:1875178210480256:0@lo:502: 00000100:00100000:1.0:1788309420.562895:0:8085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309420.562926:0:8085:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c3522b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788309420.562934:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210480256 00000100:00100000:3.0:1788309420.563007:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210480256 00000100:00100000:3.0:1788309420.563045:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788309420.563052:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+16:8085:x1875178210480256:12345-0@lo:502: 00000100:00100000:3.0:1788309420.563212:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+16:8085:x1875178210480256:12345-0@lo:502: Request processed in 160us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309420.563218:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788309420.564079:0:8085:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8f4ce1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:8085:1875178210480256:0@lo:502: 00000040:00080000:1.0:1788309420.564112:0:8085:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1788309420.564218:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1788309420.564241:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788309420.564253:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8000/0x63a04852f4628589 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4628590 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309420.564265:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8000/0x63a04852f4628589 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4628590 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788309420.564410:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788309420.564414:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff97c8e07b1000 from 5 10000000:01000000:2.0:1788309420.564426:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788309420.564607:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8e26d9200/0x63a04852f4628597 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309420.564618:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff97c8e26d9200/0x63a04852f4628597 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309420.564627:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff97c8e26d9200/0x63a04852f4628597 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309420.564647:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecf16d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210480384:0@lo:101: 00000100:00100000:2.0:1788309420.564706:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309420.564738:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c378a900 going to sleep for 11 seconds 00000100:00100000:1.0:1788309420.565236:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210480384 00000100:00100000:1.0:1788309420.565244:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210480384 00000100:00100000:1.0:1788309420.565318:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788309420.565327:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6a6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+16:5834:x1875178210480384:12345-0@lo:101: 00010000:00010000:1.0:1788309420.565338:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788309420.565352:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c8f5548200/0x63a04852f462859e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x63a04852f4628597 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309420.565376:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8f5548200/0x63a04852f462859e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63a04852f4628597 expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309420.565387:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c8f5548200/0x63a04852f462859e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f4628597 expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309420.565396:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8f5548200, rc 0) 00000100:00100000:1.0:1788309420.565453:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6a6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+17:5834:x1875178210480384:12345-0@lo:101: Request processed in 127us (746us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309420.565460:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788309420.565681:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecf16d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210480384:0@lo:101: 00010000:00010000:3.0:1788309420.565694:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff97c8e26d9200/0x63a04852f4628597 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f462859e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309420.565703:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff97c8e26d9200/0x63a04852f4628597 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x63a04852f462859e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309420.565747:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e667fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210480512:0@lo:256: 00000100:00100000:3.0:1788309420.565778:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309420.565806:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8f51d70c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788309420.565880:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210480512 00000100:00100000:0.0:1788309420.565884:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210480512 00000100:00100000:0.0:1788309420.566047:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788309420.566056:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6a6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+17:5834:x1875178210480512:12345-0@lo:256: 20000000:01000000:0.0:1788309420.566069:0:5831:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788309420.566085:0:5831:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788309420.566088:0:5831:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1788309420.566639:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6a6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+17:5834:x1875178210480512:12345-0@lo:256: Request processed in 582us (857us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309420.566648:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788309420.566813:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e667fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210480512:0@lo:256: 10000000:01000000:3.0:1788309420.566869:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788309420.566879:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8e26d9200/0x63a04852f4628597 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f462859e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309420.566902:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff97c8e26d9200/0x63a04852f4628597 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f462859e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788309420.566912:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788309420.566916:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1788309420.566919:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788309420.567046:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8c153ac00/0x63a04852f46285a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309420.567054:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff97c8c153ac00/0x63a04852f46285a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309420.567062:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff97c8c153ac00/0x63a04852f46285a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309420.567077:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e667fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210480640:0@lo:101: 00000100:00100000:3.0:1788309420.567109:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309420.567142:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8f51d70c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788309420.567188:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210480640 00000100:00100000:0.0:1788309420.567194:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210480640 00000100:00100000:0.0:1788309420.567229:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788309420.567236:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6a6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+17:5834:x1875178210480640:12345-0@lo:101: 00010000:00010000:0.0:1788309420.567245:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788309420.567256:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c8d73ee200/0x63a04852f46285ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x63a04852f46285a5 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309420.567305:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8d73ee200/0x63a04852f46285ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63a04852f46285a5 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309420.567316:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c8d73ee200/0x63a04852f46285ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f46285a5 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309420.567325:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8d73ee200, rc 0) 00000100:00100000:0.0:1788309420.567357:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6a6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+18:5834:x1875178210480640:12345-0@lo:101: Request processed in 121us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309420.567362:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788309420.567579:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e667fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210480640:0@lo:101: 00010000:00010000:3.0:1788309420.567590:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff97c8c153ac00/0x63a04852f46285a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f46285ac expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309420.567611:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff97c8c153ac00/0x63a04852f46285a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x63a04852f46285ac expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309420.567661:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e667fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210480768:0@lo:501: 00000100:00100000:3.0:1788309420.567683:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309420.567710:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8f51d70c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788309420.567754:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210480768 00000100:00100000:0.0:1788309420.567758:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210480768 00000100:00100000:0.0:1788309420.567784:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788309420.567791:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6a6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+18:5834:x1875178210480768:12345-0@lo:501: 00000100:00100000:0.0:1788309420.568178:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6a6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+18:5834:x1875178210480768:12345-0@lo:501: Request processed in 386us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309420.568185:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788309420.568247:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e667fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210480768:0@lo:501: 00000100:00100000:3.0:1788309420.568272:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e667fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210480896:0@lo:503: 00000100:00100000:3.0:1788309420.568391:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309420.568412:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8f51d70c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788309420.568618:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210480896 00000100:00100000:2.0:1788309420.568622:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210480896 00000100:00100000:2.0:1788309420.568655:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788309420.568661:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6a6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+18:5834:x1875178210480896:12345-0@lo:503: 00000100:00100000:2.0:1788309420.569127:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6a6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+18:5834:x1875178210480896:12345-0@lo:503: Request processed in 465us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309420.569134:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788309420.569190:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e667fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210480896:0@lo:503: 00000100:00100000:1.0:1788309420.570446:0:8086:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8f4ce1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:8086:1875178210481024:0@lo:502: 00000100:00100000:1.0:1788309420.570498:0:8086:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309420.570536:0:8086:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c3522f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788309420.570547:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210481024 00000100:00100000:2.0:1788309420.570553:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210481024 00000100:00100000:2.0:1788309420.570612:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788309420.570621:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6a6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+18:8086:x1875178210481024:12345-0@lo:502: 00000100:00100000:2.0:1788309420.570893:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6a6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+18:8086:x1875178210481024:12345-0@lo:502: Request processed in 273us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309420.570900:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788309420.570996:0:8086:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8f4ce1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:8086:1875178210481024:0@lo:502: 00000020:01000000:1.0:1788309420.571023:0:8086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788309420.571032:0:8086:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788309420.571038:0:8086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788309420.571041:0:8086:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788309420.571046:0:8086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788309420.571051:0:8086:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.155@tcp to nid 0x20000c0a8ca9b (192.168.202.155@tcp) 00000020:01000000:1.0:1788309420.571072:0:8086:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788309420.571075:0:8086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788309420.571096:0:8086:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff97c8ecf78000) 00000020:00000080:1.0:1788309420.571117:0:8086:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1788309420.571123:0:8086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788309420.571186:0:8086:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788309420.571191:0:8086:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788309420.571198:0:8086:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x63a04852f46285ba 00010000:00080000:1.0:1788309420.571225:0:8086:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97c8f5556000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.155@tcp at head 00010000:00010000:1.0:1788309420.571555:0:8086:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:1.0:1788309420.571854:0:8086:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1788309420.571866:0:8086:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788309420.572362:0:8086:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788309420.573079:0:8086:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788309420.573135:0:8086:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1788309420.573198:0:8086:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1788309420.573826:0:8087:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788309420.573833:0:8087:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788309420.574795:0:8086:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788309420.575037:0:8086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788309420.575079:0:8086:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788309420.575105:0:8086:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x63a04852f46285c1 00000100:00080000:1.0:1788309420.575117:0:8086:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788309420.575123:0:8086:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff97c8f5556000 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:1.0:1788309420.575160:0:8086:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97c8f4ce1880 x1875178210481152/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788309420.575220:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8f4ce1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875178210481152:0@lo:8: 00000100:00100000:2.0:1788309420.575373:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788309420.575452:0:8086:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788309420.575523:0:8086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788309420.575526:0:8086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788309420.575528:0:8086:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788309420.575531:0:8086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788309420.575535:0:8086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788309420.575536:0:8086:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788309420.575539:0:8086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788309420.575541:0:8086:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788309420.575571:0:8086:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8f4ce0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:8086:1875178210481280:0@lo:502: 00000100:00100000:1.0:1788309420.575628:0:8086:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309420.575668:0:8086:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c3522d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788309420.575838:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8c89f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875178210481792:0@lo:400: 00000100:00100000:0.0:1788309420.575868:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309420.575889:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788309420.575893:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8c89fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875178210481408:0@lo:400: 00000100:00100000:0.0:1788309420.575912:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309420.575947:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8c89f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875178210481536:0@lo:400: 00000100:00100000:0.0:1788309420.575983:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309420.576004:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788309420.576010:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8c89f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210481664:0@lo:400: 00000100:00100000:0.0:1788309420.576042:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210481792 00000100:00100000:0.0:1788309420.576048:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210481792 00000100:00100000:0.0:1788309420.576091:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210481408 00000100:00100000:0.0:1788309420.576094:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210481408 00000100:00100000:0.0:1788309420.576107:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210481536 00000100:00100000:0.0:1788309420.576109:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210481536 00000100:00100000:0.0:1788309420.576126:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788309420.576134:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c89fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875178210481792:12345-0@lo:400: 00000100:00100000:0.0:1788309420.576183:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c89fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875178210481792:12345-0@lo:400: Request processed in 49us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309420.576196:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788309420.576213:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788309420.576220:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c89f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875178210481408:12345-0@lo:400: 00000100:00100000:0.0:1788309420.576249:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c89f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875178210481408:12345-0@lo:400: Request processed in 29us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309420.576254:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788309420.576264:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788309420.576270:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8efc4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875178210481536:12345-0@lo:400: 00000100:00100000:0.0:1788309420.576332:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8efc4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875178210481536:12345-0@lo:400: Request processed in 63us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309420.576338:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1788309420.576359:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788309420.576383:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8c89fbb80 x1875178210481408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788309420.576398:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8c89fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875178210481408:0@lo:400: 00010000:00080000:0.0:1788309420.576408:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8c89f8000 x1875178210481792/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788309420.576414:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8c89f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875178210481792:0@lo:400: 00000100:00100000:2.0:1788309420.576524:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210481280 00000100:00100000:2.0:1788309420.576529:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210481280 00000100:00100000:2.0:1788309420.576556:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788309420.576563:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6a6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+18:8086:x1875178210481280:12345-0@lo:502: 00000100:00100000:2.0:1788309420.576831:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6a6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+18:8086:x1875178210481280:12345-0@lo:502: Request processed in 267us (1201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309420.576837:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788309420.576975:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309420.577041:0:8086:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8f4ce0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:8086:1875178210481280:0@lo:502: 00000020:01000000:1.0:1788309420.577066:0:8086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788309420.577072:0:8086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788309420.577074:0:8086:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788309420.577081:0:8086:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:2.0:1788309420.577565:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1788309420.577589:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788309420.577608:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8c153ac00/0x63a04852f46285a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f46285ac expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309420.577620:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff97c8c153ac00/0x63a04852f46285a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f46285ac expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788309420.577631:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788309420.577634:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff97c8e661b370 from 1 10000000:01000000:2.0:1788309420.577637:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788309420.577666:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8a00/0x63a04852f46285c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309420.577674:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8a00/0x63a04852f46285c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309420.577684:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8a00/0x63a04852f46285c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309420.577699:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecf17480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210481920:0@lo:101: 00000100:00100000:2.0:1788309420.577744:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309420.577780:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d69e8600 going to sleep for 11 seconds 00000100:00100000:1.0:1788309420.577837:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210481920 00000100:00100000:1.0:1788309420.577844:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210481920 00000100:00100000:1.0:1788309420.577887:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788309420.577895:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6a6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+18:5834:x1875178210481920:12345-0@lo:101: 00010000:00010000:1.0:1788309420.577906:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788309420.577922:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c8f5549400/0x63a04852f46285cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x63a04852f46285c8 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309420.578050:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8f5549400/0x63a04852f46285cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63a04852f46285c8 expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309420.578061:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c8f5549400/0x63a04852f46285cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f46285c8 expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309420.578069:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8f5549400, rc 0) 00000100:00100000:1.0:1788309420.578110:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6a6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:5834:x1875178210481920:12345-0@lo:101: Request processed in 215us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309420.578115:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788309420.578179:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecf17480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210481920:0@lo:101: 00010000:00010000:2.0:1788309420.578191:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8a00/0x63a04852f46285c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f46285cf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309420.578200:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8a00/0x63a04852f46285c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x63a04852f46285cf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309420.578246:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecf17480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210482048:0@lo:501: 00000100:00100000:2.0:1788309420.578268:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309420.578314:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d69e8600 going to sleep for 11 seconds 00000100:00100000:1.0:1788309420.578371:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210482048 00000100:00100000:1.0:1788309420.578375:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210482048 00000100:00100000:1.0:1788309420.578401:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788309420.578425:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6a6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:5834:x1875178210482048:12345-0@lo:501: 00000100:00100000:1.0:1788309420.579131:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6a6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:5834:x1875178210482048:12345-0@lo:501: Request processed in 704us (859us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788309420.579138:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00010000:00080000:0.0:1788309420.579330:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8c89f9880 x1875178210481536/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788309420.579343:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8c89f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875178210481536:0@lo:400: 00000100:00100000:2.0:1788309420.579399:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecf17480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210482048:0@lo:501: 10000000:01000000:2.0:1788309420.579421:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788309420.579429:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8a00/0x63a04852f46285c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f46285cf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309420.579446:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8a00/0x63a04852f46285c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f46285cf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309420.579564:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210481152 00000100:00100000:3.0:1788309420.579571:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210481152 00000100:00100000:3.0:1788309420.579631:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210481664 00000100:00100000:3.0:1788309420.579634:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210481664 00000100:00100000:1.0:1788309420.579724:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788309420.579734:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8efc4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1875178210481664:12345-0@lo:400: 00000100:00100000:1.0:1788309420.579773:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8efc4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1875178210481664:12345-0@lo:400: Request processed in 42us (2798us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309420.579779:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788309420.579792:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788309420.579795:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecf16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3299:x1875178210481152:12345-0@lo:8: 00010000:00080000:1.0:1788309420.579819:0:6680:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 183 last 0 00000020:00000080:1.0:1788309420.579849:0:6680:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x63a04852f46285d6 00002000:00100000:1.0:1788309420.579862:0:6680:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff97c8fc780800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211392d ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788309420.579867:0:6680:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:1.0:1788309420.579870:0:6680:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1788309420.579997:0:6680:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788309420.580186:0:6680:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788309420.580211:0:6680:0:(import.c:65:import_set_state_nolock()) ffff97c8fc785000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788309420.580251:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecf16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3299:x1875178210481152:12345-0@lo:8: Request processed in 454us (4879us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309420.580258:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788309420.580321:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8f4ce1880 x1875178210481152/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788309430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788309420.580330:0:3299:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788309420.580337:0:3299:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788309420.580344:0:3299:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788309420.580349:0:3299:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788309420.580352:0:3299:0:(import.c:65:import_set_state_nolock()) ffff97c8f5556000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788309420.580368:0:3299:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788309420.580373:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8f4ce1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875178210481152:0@lo:8: 00010000:00080000:2.0:1788309420.580405:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8c89f9180 x1875178210481664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788309436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788309420.580414:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8c89f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210481664:0@lo:400: 00000100:00080000:0.0:1788309420.580674:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1788309420.587313:0:8087:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788309420.588611:0:8087:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 183339331960ns, next at 0ns, rc = 0 00000100:00100000:2.0:1788309420.639900:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8f4ce0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210482176:0@lo:13: 00000100:00100000:2.0:1788309420.640002:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788309420.640066:0:8088:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1788309420.640092:0:8088:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8f4ce2300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8088:1875178210482304:0@lo:7: 00000100:00100000:1.0:1788309420.640129:0:8088:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309420.640193:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210482304 00000100:00100000:1.0:1788309420.640568:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210482304 00000100:00100000:1.0:1788309420.640647:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788309420.640658:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f4ce3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8088:x1875178210482304:12345-0@lo:7: 00000100:00080000:0.0:1788309420.641343:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788309420.643009:0:8088:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c35220c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788309420.646588:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210482176 00000100:00100000:3.0:1788309420.646611:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210482176 00000100:00100000:2.0:1788309420.646746:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788309420.646760:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecf17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1875178210482176:12345-0@lo:13: 00002000:00000024:2.0:1788309420.646796:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1788309420.646902:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecf17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1875178210482176:12345-0@lo:13: Request processed in 145us (6900us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309420.646909:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788309420.647009:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8f4ce0000 x1875178210482176/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788309436 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788309420.647048:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8f4ce0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210482176:0@lo:13: 00002000:00080000:1.0:1788309420.652567:0:6682:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1788309420.652575:0:6682:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1788309420.652691:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f4ce3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8088:x1875178210482304:12345-0@lo:7: Request processed in 12030us (12555us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309420.652704:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788309420.653063:0:8088:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8f4ce2300 x1875178210482304/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788309436 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788309420.653080:0:8088:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8f4ce2300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8088:1875178210482304:0@lo:7: 00000004:00080000:0.0:1788309420.653094:0:8088:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1788309420.653133:0:8088:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8efc4dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8088:1875178210482432:0@lo:5: 00000100:00100000:0.0:1788309420.653171:0:8088:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309420.653207:0:8088:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d3a5e240 going to sleep for 11 seconds 00000100:00100000:1.0:1788309420.653222:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210482432 00000100:00100000:1.0:1788309420.653230:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210482432 00000100:00100000:1.0:1788309420.653340:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788309420.653351:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8efc4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8088:x1875178210482432:12345-0@lo:5: 00002000:00080000:1.0:1788309420.653375:0:6680:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1788309420.653378:0:6680:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1788309420.653678:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8efc4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:8088:x1875178210482432:12345-0@lo:5: Request processed in 327us (505us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788309420.653686:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788309420.653915:0:8088:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8efc4dc00 x1875178210482432/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788309436 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788309420.653927:0:8088:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8efc4dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8088:1875178210482432:0@lo:5: 00000004:00080000:1.0:1788309420.653935:0:8088:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1788309420.653959:0:8088:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8f4ce0700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8088:1875178210482560:0@lo:700: 00000100:00100000:1.0:1788309420.653985:0:8088:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309420.654046:0:8088:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c2c2d180 going to sleep for 11 seconds 00000100:00100000:3.0:1788309420.654085:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210482560 00000100:00100000:3.0:1788309420.654091:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210482560 00000100:00100000:3.0:1788309420.654162:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788309420.654171:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f4ce2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8088:x1875178210482560:12345-0@lo:700: 00000100:00100000:3.0:1788309420.654211:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e667fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6689:1875178210482688:0@lo:700: 00000100:00100000:3.0:1788309420.654244:0:6689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309420.654326:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8f51d7480 going to sleep for 11 seconds 00000100:00100000:0.0:1788309420.654847:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210482688 00000100:00100000:0.0:1788309420.654853:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210482688 00000100:00100000:0.0:1788309420.654897:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788309420.654905:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e667c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6689:x1875178210482688:12345-0@lo:700: 00000004:00080000:1.0:1788309420.682153:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 40000000:02000000:3.0:1788309420.732166:0:5844:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:1.0:1788309420.739695:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e667c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6689:x1875178210482688:12345-0@lo:700: Request processed in 84782us (85441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309420.739724:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788309420.739860:0:6689:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8e667fb80 x1875178210482688/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788309436 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788309420.739877:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e667fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6689:1875178210482688:0@lo:700: 40000000:02000000:3.0:1788309420.739891:0:6689:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00010000:00010000:2.0:1788309420.782067:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788309420.807830:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f4ce2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8088:x1875178210482560:12345-0@lo:700: Request processed in 153649us (153833us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309420.807845:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788309420.807952:0:8088:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8f4ce0700 x1875178210482560/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788309436 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788309420.807970:0:8088:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8f4ce0700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8088:1875178210482560:0@lo:700: 00000001:00080000:1.0:1788309420.808409:0:7639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:1.0:1788309420.808424:0:7639:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000004:02000040:0.0:1788309420.832831:0:8088:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:1.0:1788309420.838883:0:8088:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8f4ce0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8088:1875178210482816:0@lo:5: 00000100:00100000:1.0:1788309420.839020:0:8088:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309420.839181:0:8088:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8edd33b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788309420.839327:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210482816 00000100:00100000:3.0:1788309420.839335:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210482816 00000100:00100000:3.0:1788309420.839385:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788309420.839395:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f4ce1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8088:x1875178210482816:12345-0@lo:5: 00002000:00080000:3.0:1788309420.845914:0:6682:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1788309420.845935:0:6682:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1788309420.849481:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f4ce1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8088:x1875178210482816:12345-0@lo:5: Request processed in 10080us (10453us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788309420.849497:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788309420.849835:0:8088:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8f4ce0000 x1875178210482816/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788309436 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788309420.849852:0:8088:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788309420.849867:0:8088:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff97c8f4ce0000 x1875178210482816/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788309436 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788309420.849878:0:8088:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8f4ce0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8088:1875178210482816:0@lo:5: 00000004:00080000:1.0:1788309420.849894:0:8088:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:0.0:1788309421.540132:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788309421.540164:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8efc4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210482944:0@lo:13: 00000100:00100000:0.0:1788309421.540259:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309421.540356:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210482944 00000100:00100000:0.0:1788309421.540364:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210482944 00000100:00100000:0.0:1788309421.540415:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788309421.540426:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8efc4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875178210482944:12345-0@lo:13: 00002000:00000024:0.0:1788309421.540463:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788309421.540515:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8efc4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875178210482944:12345-0@lo:13: Request processed in 90us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309421.540532:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788309421.540573:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8efc4ca80 x1875178210482944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788309437 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788309421.540605:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8efc4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210482944:0@lo:13: 00010000:00010000:2.0:1788309421.792493:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309422.816600:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788309423.223014:0:7639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:1.0:1788309423.840939:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309423.841014:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192633984 00000100:00100000:1.0:1788309423.841044:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192633984 00000100:00100000:1.0:1788309423.841101:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 112 00000100:00100000:1.0:1788309423.841113:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6a6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2349:x1875178192633984:12345-192.168.202.55@tcp:250: 00010000:00080000:1.0:1788309423.841153:0:5832:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from f8351692-8d1a-4b41-bdaf-bf179786ff59@192.168.202.55@tcp t0 exp 0000000000000000 cur 186 last 0 00000020:00000080:1.0:1788309423.841194:0:5832:0:(genops.c:1385:class_connect()) connect: client f8351692-8d1a-4b41-bdaf-bf179786ff59, cookie 0x63a04852f46285dd 00000100:00080000:1.0:1788309423.841407:0:5832:0:(import.c:65:import_set_state_nolock()) ffff97c8fc782000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788309423.842580:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6a6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8351692-8d1a-4b41-bdaf-bf179786ff59+5:2349:x1875178192633984:12345-192.168.202.55@tcp:250: Request processed in 1451us (1654us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309423.842596:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 112 00010000:00010000:1.0:1788309423.844934:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788309423.848642:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309423.848747:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192634112 00000100:00100000:3.0:1788309423.848761:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192634112 00000100:00100000:3.0:1788309423.848840:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 113 00000100:00100000:3.0:1788309423.848852:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6a6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8351692-8d1a-4b41-bdaf-bf179786ff59+5:5578:x1875178192634112:12345-192.168.202.55@tcp:101: 00010000:00010000:3.0:1788309423.848876:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309423.848902:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c8c153bc00/0x63a04852f46285e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8a28c761146a89c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309423.848953:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8c153bc00/0x63a04852f46285e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a89c expref: 6 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309423.848993:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c8c153bc00/0x63a04852f46285e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a89c expref: 6 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309423.849005:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8c153bc00, rc 0) 00000100:00100000:3.0:1788309423.849075:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6a6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8351692-8d1a-4b41-bdaf-bf179786ff59+6:5578:x1875178192634112:12345-192.168.202.55@tcp:101: Request processed in 225us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309423.849082:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 113 00000100:00100000:1.0:1788309423.853325:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309423.853907:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192634240 00000100:00100000:2.0:1788309423.853933:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192634240 00000100:00100000:2.0:1788309423.854010:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 114 00000100:00100000:2.0:1788309423.854024:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6a6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8351692-8d1a-4b41-bdaf-bf179786ff59+6:5578:x1875178192634240:12345-192.168.202.55@tcp:501: 00000100:00100000:2.0:1788309423.854883:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6a6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8351692-8d1a-4b41-bdaf-bf179786ff59+6:5578:x1875178192634240:12345-192.168.202.55@tcp:501: Request processed in 854us (1605us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788309423.854894:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 114 00000100:00100000:0.0:1788309423.863639:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309423.863902:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192634368 00000100:00100000:3.0:1788309423.863926:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192634368 00000100:00100000:3.0:1788309423.863998:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 115 00000100:00100000:3.0:1788309423.864011:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6a6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8351692-8d1a-4b41-bdaf-bf179786ff59+6:5578:x1875178192634368:12345-192.168.202.55@tcp:101: 00010000:00010000:3.0:1788309423.864170:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309423.864196:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c8c153a000/0x63a04852f46285eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8a28c761146a8a3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309423.864235:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8c153a000/0x63a04852f46285eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a8a3 expref: 7 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309423.864248:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c8c153a000/0x63a04852f46285eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a8a3 expref: 7 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309423.864259:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8c153a000, rc 0) 00000100:00100000:3.0:1788309423.864382:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6a6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8351692-8d1a-4b41-bdaf-bf179786ff59+7:5578:x1875178192634368:12345-192.168.202.55@tcp:101: Request processed in 372us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309423.864390:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 115 00000100:00100000:3.0:1788309423.876934:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309423.877370:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192634496 00000100:00100000:2.0:1788309423.877385:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192634496 00000100:00100000:2.0:1788309423.877484:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 116 00000100:00100000:2.0:1788309423.877499:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6a6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8351692-8d1a-4b41-bdaf-bf179786ff59+7:5578:x1875178192634496:12345-192.168.202.55@tcp:501: 00000100:00100000:2.0:1788309423.877983:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6a6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8351692-8d1a-4b41-bdaf-bf179786ff59+8:5578:x1875178192634496:12345-192.168.202.55@tcp:501: Request processed in 485us (1061us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309423.877996:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 116 00000100:00100000:0.0:1788309423.890057:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309423.890142:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192634624 00000100:00100000:0.0:1788309423.890156:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192634624 00000100:00100000:0.0:1788309423.890230:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 117 00000100:00100000:0.0:1788309423.890244:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6a6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8351692-8d1a-4b41-bdaf-bf179786ff59+8:5578:x1875178192634624:12345-192.168.202.55@tcp:503: 00000100:00100000:0.0:1788309423.890823:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6a6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8351692-8d1a-4b41-bdaf-bf179786ff59+8:5578:x1875178192634624:12345-192.168.202.55@tcp:503: Request processed in 577us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309423.890834:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 117 00000100:00100000:0.0:1788309423.897339:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309423.897460:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192634752 00000100:00100000:3.0:1788309423.897492:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192634752 00000100:00100000:3.0:1788309423.897575:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 118 00000100:00100000:3.0:1788309423.897588:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6a6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8351692-8d1a-4b41-bdaf-bf179786ff59+8:5596:x1875178192634752:12345-192.168.202.55@tcp:502: 00000100:00100000:3.0:1788309423.898384:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6a6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8351692-8d1a-4b41-bdaf-bf179786ff59+8:5596:x1875178192634752:12345-192.168.202.55@tcp:502: Request processed in 795us (1106us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309423.898396:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 118 00000100:00100000:1.0:1788309423.927369:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309423.927531:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192634880 00000100:00100000:2.0:1788309423.927544:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192634880 00000100:00100000:2.0:1788309423.927620:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 119 00000100:00100000:2.0:1788309423.927632:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6b2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8351692-8d1a-4b41-bdaf-bf179786ff59+8:5596:x1875178192634880:12345-192.168.202.55@tcp:502: 00000100:00100000:2.0:1788309423.927985:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6b2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8351692-8d1a-4b41-bdaf-bf179786ff59+8:5596:x1875178192634880:12345-192.168.202.55@tcp:502: Request processed in 353us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309423.927994:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 119 00000100:00100000:1.0:1788309423.959603:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309423.960055:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192635008 00000100:00100000:0.0:1788309423.960072:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192635008 00000100:00100000:0.0:1788309423.962330:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 120 00000100:00100000:0.0:1788309423.962356:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6b2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8351692-8d1a-4b41-bdaf-bf179786ff59+8:5578:x1875178192635008:12345-192.168.202.55@tcp:101: 00010000:00010000:0.0:1788309423.962384:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788309423.962408:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c8d73ef400/0x63a04852f46285f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8a28c761146a8cd expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309423.962448:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8d73ef400/0x63a04852f46285f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a8cd expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309423.962481:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c8d73ef400/0x63a04852f46285f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a8cd expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309423.962494:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8d73ef400, rc 0) 00000100:00100000:0.0:1788309423.962595:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6b2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8351692-8d1a-4b41-bdaf-bf179786ff59+9:5578:x1875178192635008:12345-192.168.202.55@tcp:101: Request processed in 249us (3010us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309423.962603:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 120 00000100:00100000:1.0:1788309423.977981:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309423.978256:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192635136 00000100:00100000:3.0:1788309423.978271:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192635136 00000100:00100000:3.0:1788309423.978373:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 121 00000100:00100000:3.0:1788309423.978387:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6b2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8351692-8d1a-4b41-bdaf-bf179786ff59+9:5578:x1875178192635136:12345-192.168.202.55@tcp:256: 20000000:01000000:3.0:1788309423.978503:0:5831:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788309423.978534:0:5831:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788309423.978538:0:5831:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788309423.978543:0:5831:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788309423.978546:0:5831:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1788309423.982649:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6b2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8351692-8d1a-4b41-bdaf-bf179786ff59+9:5578:x1875178192635136:12345-192.168.202.55@tcp:256: Request processed in 4244us (4666us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309423.982668:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 121 00000100:00100000:3.0:1788309423.992223:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309423.992700:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192635264 00000100:00100000:1.0:1788309423.992716:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192635264 00000100:00100000:1.0:1788309423.992793:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 122 00000100:00100000:1.0:1788309423.992807:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6b2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8351692-8d1a-4b41-bdaf-bf179786ff59+9:5578:x1875178192635264:12345-192.168.202.55@tcp:101: 00010000:00010000:1.0:1788309423.992830:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788309423.992854:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c8f5549e00/0x63a04852f46285f9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8a28c761146a8d4 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309423.993243:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8f5549e00/0x63a04852f46285f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a8d4 expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309423.993257:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c8f5549e00/0x63a04852f46285f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a8d4 expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309423.993316:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8f5549e00, rc 0) 00000100:00100000:1.0:1788309423.993393:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6b2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8351692-8d1a-4b41-bdaf-bf179786ff59+10:5578:x1875178192635264:12345-192.168.202.55@tcp:101: Request processed in 589us (1642us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309423.993401:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 122 00000100:00100000:1.0:1788309423.995847:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309423.996099:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192635392 00000100:00100000:2.0:1788309423.996113:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192635392 00000100:00100000:2.0:1788309423.996173:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 123 00000100:00100000:2.0:1788309423.996184:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6b2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8351692-8d1a-4b41-bdaf-bf179786ff59+10:5578:x1875178192635392:12345-192.168.202.55@tcp:501: 00000100:00100000:2.0:1788309423.997087:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6b2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8351692-8d1a-4b41-bdaf-bf179786ff59+10:5578:x1875178192635392:12345-192.168.202.55@tcp:501: Request processed in 898us (1249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309423.997100:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 123 00000100:00100000:1.0:1788309423.999708:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309423.999765:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192635520 00000100:00100000:1.0:1788309423.999776:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192635520 00000100:00100000:1.0:1788309423.999842:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 124 00000100:00100000:1.0:1788309423.999855:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6b2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8351692-8d1a-4b41-bdaf-bf179786ff59+10:5578:x1875178192635520:12345-192.168.202.55@tcp:503: 00000100:00100000:1.0:1788309424.003835:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6b2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8351692-8d1a-4b41-bdaf-bf179786ff59+10:5578:x1875178192635520:12345-192.168.202.55@tcp:503: Request processed in 3962us (4132us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309424.003854:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 124 00000100:00100000:0.0:1788309424.016119:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309424.016642:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192635648 00000100:00100000:2.0:1788309424.016663:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192635648 00000100:00100000:2.0:1788309424.016862:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 125 00000100:00100000:2.0:1788309424.016878:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6b2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8351692-8d1a-4b41-bdaf-bf179786ff59+10:5600:x1875178192635648:12345-192.168.202.55@tcp:502: 00000100:00100000:2.0:1788309424.017447:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6b2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8351692-8d1a-4b41-bdaf-bf179786ff59+10:5600:x1875178192635648:12345-192.168.202.55@tcp:502: Request processed in 568us (1345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309424.017458:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 125 00000100:00100000:1.0:1788309424.030298:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309424.030880:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192635776 00000100:00100000:2.0:1788309424.030993:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192635776 00000100:00100000:2.0:1788309424.031858:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 126 00000100:00100000:2.0:1788309424.031882:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6b2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8351692-8d1a-4b41-bdaf-bf179786ff59+10:5600:x1875178192635776:12345-192.168.202.55@tcp:502: 00000100:00100000:2.0:1788309424.032305:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6b2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8351692-8d1a-4b41-bdaf-bf179786ff59+10:5600:x1875178192635776:12345-192.168.202.55@tcp:502: Request processed in 404us (2028us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309424.032316:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 126 00000100:00100000:1.0:1788309424.036688:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309424.036826:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192635904 00000100:00100000:2.0:1788309424.036841:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192635904 00000100:00100000:2.0:1788309424.037016:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 4 00000100:00100000:2.0:1788309424.037029:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f4ce0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2349:x1875178192635904:12345-192.168.202.55@tcp:38: 00010000:00080000:2.0:1788309424.037079:0:5839:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 86451057-f8bb-4d7c-a7c2-5c834b43e3d3@192.168.202.55@tcp t0 exp 0000000000000000 cur 186 last 0 00000020:00000080:2.0:1788309424.037164:0:5839:0:(genops.c:1385:class_connect()) connect: client 86451057-f8bb-4d7c-a7c2-5c834b43e3d3, cookie 0x63a04852f4628600 00000004:00100000:2.0:1788309424.037213:0:5839:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1788309424.037223:0:5839:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1788309424.095662:0:5839:0:(import.c:65:import_set_state_nolock()) ffff97c8fc786800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788309424.097308:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f4ce0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:2349:x1875178192635904:12345-192.168.202.55@tcp:38: Request processed in 60240us (60605us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309424.097329:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 4 00010000:00010000:2.0:1788309424.865716:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788309425.109543:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309425.109926:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192636160 00000100:00100000:0.0:1788309425.109940:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192636160 00000100:00100000:0.0:1788309425.110054:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 5 00000100:00100000:0.0:1788309425.110071:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e667fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:5578:x1875178192636160:12345-192.168.202.55@tcp:41: 00000004:00000024:0.0:1788309425.110148:0:5838:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788309425.110261:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e667fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:5578:x1875178192636160:12345-192.168.202.55@tcp:41: Request processed in 194us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309425.110269:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 5 00000100:00080000:2.0:1788309425.110417:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788309425.111562:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309425.119989:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192636032 00000100:00100000:1.0:1788309425.120008:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192636032 00000100:00100000:1.0:1788309425.120377:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 6 00000100:00100000:1.0:1788309425.121163:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8efc4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:0:x1875178192636032:12345-192.168.202.55@tcp:41: 00000004:00000024:1.0:1788309425.121227:0:5839:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788309425.137675:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8efc4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:0:x1875178192636032:12345-192.168.202.55@tcp:41: Request processed in 17265us (26449us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309425.137697:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 6 00000100:00100000:0.0:1788309425.142890:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309425.146051:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192636288 00000100:00100000:1.0:1788309425.146073:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192636288 00000100:00100000:1.0:1788309425.146160:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 7 00000100:00100000:1.0:1788309425.146171:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8efc4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:5578:x1875178192636288:12345-192.168.202.55@tcp:40: 00000100:00100000:1.0:1788309425.146317:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8efc4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:5578:x1875178192636288:12345-192.168.202.55@tcp:40: Request processed in 148us (3443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309425.146323:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 7 00000100:00100000:3.0:1788309425.156525:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309425.156597:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309425.156631:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309425.156681:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309425.157370:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192636672 00000100:00100000:0.0:1788309425.157384:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192636672 00000100:00100000:0.0:1788309425.157475:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 0 00000100:00100000:0.0:1788309425.157490:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e667d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:5578:x1875178192636672:12345-192.168.202.55@tcp:33: 00000100:00100000:1.0:1788309425.157717:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192636416 00000100:00100000:1.0:1788309425.157722:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192636416 00000100:00100000:1.0:1788309425.157772:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192636544 00000100:00100000:1.0:1788309425.157776:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192636544 00000100:00100000:1.0:1788309425.157805:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 8 00000100:00100000:1.0:1788309425.157812:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e667ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2349:x1875178192636416:12345-192.168.202.55@tcp:8: 00010000:00080000:1.0:1788309425.157842:0:6680:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 86451057-f8bb-4d7c-a7c2-5c834b43e3d3@192.168.202.55@tcp t0 exp 0000000000000000 cur 187 last 0 00000020:00000080:1.0:1788309425.157890:0:6680:0:(genops.c:1385:class_connect()) connect: client 86451057-f8bb-4d7c-a7c2-5c834b43e3d3, cookie 0x63a04852f4628607 00002000:00100000:1.0:1788309425.157916:0:6680:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 86451057-f8bb-4d7c-a7c2-5c834b43e3d3/ffff97c8fc785800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392d ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788309425.157948:0:6680:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788309425.158487:0:6680:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788309425.158531:0:6680:0:(import.c:65:import_set_state_nolock()) ffff97c8fc787000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788309425.158633:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e667ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:2349:x1875178192636416:12345-192.168.202.55@tcp:8: Request processed in 818us (2033us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309425.158642:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 8 00000100:00100000:1.0:1788309425.158670:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 9 00000100:00100000:1.0:1788309425.158676:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e667f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2349:x1875178192636544:12345-192.168.202.55@tcp:8: 00010000:00080000:1.0:1788309425.158695:0:6680:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 86451057-f8bb-4d7c-a7c2-5c834b43e3d3@192.168.202.55@tcp t0 exp 0000000000000000 cur 187 last 0 00000020:00000080:1.0:1788309425.158718:0:6680:0:(genops.c:1385:class_connect()) connect: client 86451057-f8bb-4d7c-a7c2-5c834b43e3d3, cookie 0x63a04852f462860e 00002000:00100000:1.0:1788309425.158726:0:6680:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 86451057-f8bb-4d7c-a7c2-5c834b43e3d3/ffff97c8fc781800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392d ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788309425.158745:0:6680:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788309425.158969:0:6680:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788309425.158983:0:6680:0:(import.c:65:import_set_state_nolock()) ffff97c8fc784000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788309425.159004:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e667f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:2349:x1875178192636544:12345-192.168.202.55@tcp:8: Request processed in 328us (2374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309425.159009:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 9 00000100:00100000:2.0:1788309425.159743:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192636800 00000100:00100000:2.0:1788309425.159756:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192636800 00000100:00100000:2.0:1788309425.159832:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 127 00000100:00100000:2.0:1788309425.159844:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6b2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8351692-8d1a-4b41-bdaf-bf179786ff59+10:2351:x1875178192636800:12345-192.168.202.55@tcp:400: 00000100:00100000:2.0:1788309425.159896:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6b2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8351692-8d1a-4b41-bdaf-bf179786ff59+10:2351:x1875178192636800:12345-192.168.202.55@tcp:400: Request processed in 56us (3215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309425.159977:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 127 00000004:00080000:0.0:1788309425.204202:0:5840:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 46609us 00000004:00200000:2.0:1788309425.268547:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1788309425.268805:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e667d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:5578:x1875178192636672:12345-192.168.202.55@tcp:33: Request processed in 111309us (112287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309425.268838:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 0 00000100:00100000:3.0:1788309425.524950:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309425.526095:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192636928 00000100:00100000:1.0:1788309425.526124:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192636928 00000100:00100000:1.0:1788309425.526223:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 8 00000100:00100000:1.0:1788309425.526237:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e667ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:5618:x1875178192636928:12345-192.168.202.55@tcp:101: 00010000:00010000:1.0:1788309425.526930:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788309425.532667:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549c00/0x63a04852f4628615 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146a8fe expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309425.532791:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548600/0x63a04852f462861c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309425.532807:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548600/0x63a04852f462861c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309425.532823:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548600/0x63a04852f462861c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788309425.533047:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1788309425.533052:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1788309425.533135:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548600/0x63a04852f462861c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309425.533171:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549c00/0x63a04852f4628615 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a8fe expref: 8 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309425.533205:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548600/0x63a04852f462861c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a8fe expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309425.533215:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c8d832f100) 00010000:00010000:1.0:1788309425.533219:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788309425.533223:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8f5548600, rc 0) 00000100:00100000:1.0:1788309425.533367:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e667ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+7:5618:x1875178192636928:12345-192.168.202.55@tcp:101: Request processed in 7132us (8431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309425.533376:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 8 00000100:00100000:1.0:1788309425.633718:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788309425.633782:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e667c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210483456:0@lo:400: 00000100:00100000:3.0:1788309425.633801:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e667df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875178210483328:0@lo:400: 00000100:00100000:0.0:1788309425.633984:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e667e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875178210483584:0@lo:400: 00000100:00100000:3.0:1788309425.638103:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309425.638188:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788309425.638203:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e667ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875178210483200:0@lo:400: 00000100:00100000:3.0:1788309425.638253:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309425.638309:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e667c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210483712:0@lo:400: 00000100:00100000:3.0:1788309425.638339:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309425.638398:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210483328 00000100:00100000:3.0:1788309425.638406:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210483328 00000100:00100000:3.0:1788309425.638469:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210483200 00000100:00100000:3.0:1788309425.638473:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210483200 00000100:00100000:3.0:1788309425.638492:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788309425.638502:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e667f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875178210483328:12345-0@lo:400: 00000100:00100000:3.0:1788309425.638579:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e667f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875178210483328:12345-0@lo:400: Request processed in 77us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309425.638587:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788309425.638606:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788309425.638613:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e667d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875178210483200:12345-0@lo:400: 00000100:00100000:3.0:1788309425.638642:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e667d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875178210483200:12345-0@lo:400: Request processed in 30us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309425.638648:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1788309425.638665:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788309425.638701:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e667ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875178210483200:0@lo:400: 00000100:00100000:3.0:1788309425.638716:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e667df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875178210483328:0@lo:400: 00000100:00100000:0.0:1788309425.640711:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309425.641228:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309425.641305:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210483712 00000100:00100000:1.0:1788309425.641316:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210483712 00000100:00100000:1.0:1788309425.641389:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210483456 00000100:00100000:1.0:1788309425.641393:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210483456 00000100:00100000:1.0:1788309425.641416:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788309425.641427:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e667d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210483712:12345-0@lo:400: 00000100:00100000:1.0:1788309425.641503:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e667d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210483712:12345-0@lo:400: Request processed in 79us (3163us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309425.641511:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788309425.641529:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788309425.641536:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f4ce2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1875178210483456:12345-0@lo:400: 00000100:00100000:0.0:1788309425.642370:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210483584 00000100:00100000:0.0:1788309425.642378:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210483584 00000100:00100000:0.0:1788309425.642423:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788309425.642432:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8efc4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875178210483584:12345-0@lo:400: 00000100:00100000:0.0:1788309425.642485:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8efc4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875178210483584:12345-0@lo:400: Request processed in 55us (1788us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309425.642491:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788309425.642559:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e667e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875178210483584:0@lo:400: 00010000:00080000:0.0:1788309425.642615:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8e667c000 x1875178210483456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788309441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788309425.642627:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e667c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210483456:0@lo:400: 00000100:00100000:0.0:1788309425.642639:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e667f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3300:1875178210483072:0@lo:400: 00000100:00100000:0.0:1788309425.642683:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788309425.646196:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8e667c380 x1875178210483712/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788309441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788309425.646218:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788309425.646246:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e667c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210483712:0@lo:400: 00000100:00080000:2.0:1788309425.646354:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788309425.646363:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788309425.646368:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788309425.647081:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210483072 00000100:00100000:3.0:1788309425.647096:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210483072 00000100:00100000:3.0:1788309425.647162:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788309425.647175:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6ae8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:3300:x1875178210483072:12345-0@lo:400: 00000100:00100000:3.0:1788309425.648990:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6ae8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:3300:x1875178210483072:12345-0@lo:400: Request processed in 1811us (6299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309425.649003:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788309425.649138:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e667f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3300:1875178210483072:0@lo:400: 00000100:00100000:1.0:1788309425.653387:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f4ce2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1875178210483456:12345-0@lo:400: Request processed in 44us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309425.653410:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000001:00100000:3.0:1788309425.745603:0:6706:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 86451057-f8bb-4d7c-a7c2-5c834b43e3d3 00010000:00010000:2.0:1788309425.888881:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788309426.146209:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8f4ce3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210483840:0@lo:13: 00000100:00100000:2.0:1788309426.146361:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309426.146589:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210483840 00000100:00100000:1.0:1788309426.146600:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210483840 00000100:00100000:1.0:1788309426.146688:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788309426.146701:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecf14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210483840:12345-0@lo:13: 00002000:00000024:1.0:1788309426.146733:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788309426.155748:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecf14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210483840:12345-0@lo:13: Request processed in 9028us (9366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309426.155781:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788309426.156406:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8f4ce3480 x1875178210483840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788309442 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788309426.156443:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8f4ce3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210483840:0@lo:13: 00000100:00100000:1.0:1788309426.658581:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788309426.658619:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8f4ce0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210483968:0@lo:13: 00000100:00100000:1.0:1788309426.658718:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309426.658817:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210483968 00000100:00100000:1.0:1788309426.658828:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210483968 00000100:00100000:1.0:1788309426.661557:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788309426.661588:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f4ce1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875178210483968:12345-0@lo:13: 00002000:00000024:1.0:1788309426.661652:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788309426.661800:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f4ce1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875178210483968:12345-0@lo:13: Request processed in 219us (3082us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309426.661808:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1788309426.662407:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8f4ce0a80 x1875178210483968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788309442 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788309426.662443:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8f4ce0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210483968:0@lo:13: 00010000:00010000:0.0:1788309426.913853:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788309427.673274:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309427.673510:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192637056 00000100:00100000:1.0:1788309427.673523:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192637056 00000100:00100000:1.0:1788309427.673662:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 9 00000100:00100000:1.0:1788309427.673675:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8efc4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+7:5670:x1875178192637056:12345-192.168.202.55@tcp:41: 00000004:00000024:1.0:1788309427.673731:0:5839:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788309427.673813:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8efc4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+7:5670:x1875178192637056:12345-192.168.202.55@tcp:41: Request processed in 142us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309427.673820:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 9 00000100:00080000:2.0:1788309427.674080:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788309427.677452:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309427.677584:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192637184 00000100:00100000:1.0:1788309427.677600:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192637184 00000100:00100000:1.0:1788309427.677740:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 9 00000100:00100000:1.0:1788309427.677752:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8efc4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+5:5670:x1875178192637184:12345-192.168.202.55@tcp:13: 00002000:00000024:1.0:1788309427.677783:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788309427.677948:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8efc4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+5:5670:x1875178192637184:12345-192.168.202.55@tcp:13: Request processed in 197us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309427.677956:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 9 00000100:00080000:2.0:1788309427.678108:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788309427.681010:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309427.681079:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192637312 00000100:00100000:3.0:1788309427.681092:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192637312 00000100:00100000:3.0:1788309427.681330:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 10 00000100:00100000:3.0:1788309427.681346:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f4ce1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:5670:x1875178192637312:12345-192.168.202.55@tcp:13: 00002000:00000024:3.0:1788309427.681406:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788309427.681496:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f4ce1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:5670:x1875178192637312:12345-192.168.202.55@tcp:13: Request processed in 153us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309427.681505:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 10 00000100:00080000:1.0:1788309427.686030:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788309427.936733:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309428.960459:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788309429.289268:0:5859:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 86451057-f8bb-4d7c-a7c2-5c834b43e3d3 00000001:00100000:1.0:1788309429.798390:0:7639:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 86451057-f8bb-4d7c-a7c2-5c834b43e3d3 00010000:00010000:3.0:1788309429.987853:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788309430.198714:0:8293:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1788309430.219853:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309430.219902:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309430.219928:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309430.219950:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309430.219978:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192637696 00000100:00100000:3.0:1788309430.219988:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192637696 00000100:00100000:3.0:1788309430.220038:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192637824 00000100:00100000:3.0:1788309430.220041:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192637824 00000100:00100000:3.0:1788309430.220061:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 5 00000100:00100000:3.0:1788309430.220070:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e667f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+5:2350:x1875178192637696:12345-192.168.202.55@tcp:400: 00000100:00100000:3.0:1788309430.220139:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e667f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+5:2350:x1875178192637696:12345-192.168.202.55@tcp:400: Request processed in 69us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309430.220146:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 5 00000100:00100000:3.0:1788309430.220163:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 6 00000100:00100000:3.0:1788309430.220169:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e667ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+5:2350:x1875178192637824:12345-192.168.202.55@tcp:400: 00000100:00100000:3.0:1788309430.220202:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e667ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+5:2350:x1875178192637824:12345-192.168.202.55@tcp:400: Request processed in 33us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309430.220208:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 6 00000100:00080000:3.0:1788309430.220226:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788309430.220229:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788309430.221462:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192637440 00000100:00100000:0.0:1788309430.221469:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192637440 00000100:00100000:0.0:1788309430.230932:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 129 00000100:00100000:0.0:1788309430.230951:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6ae8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8351692-8d1a-4b41-bdaf-bf179786ff59+10:2350:x1875178192637440:12345-192.168.202.55@tcp:400: 00000100:00100000:0.0:1788309430.231026:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6ae8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8351692-8d1a-4b41-bdaf-bf179786ff59+10:2350:x1875178192637440:12345-192.168.202.55@tcp:400: Request processed in 81us (11184us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309430.231033:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 129 00000100:00100000:2.0:1788309430.249060:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192637568 00000100:00100000:2.0:1788309430.249075:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192637568 00000100:00080000:2.0:1788309430.250951:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788309430.251021:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 20 00000100:00100000:2.0:1788309430.251034:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e667df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:2350:x1875178192637568:12345-192.168.202.55@tcp:400: 00000100:00100000:2.0:1788309430.252222:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e667df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:2350:x1875178192637568:12345-192.168.202.55@tcp:400: Request processed in 1187us (32287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309430.252232:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 20 00000100:00100000:1.0:1788309430.752645:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8efc4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3301:1875178210484096:0@lo:400: 00000100:00100000:0.0:1788309430.752719:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8efc4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875178210484224:0@lo:400: 00000100:00100000:1.0:1788309430.752726:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309430.752775:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309430.752780:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8efc4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875178210484608:0@lo:400: 00000100:00100000:0.0:1788309430.752803:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8efc4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875178210484736:0@lo:400: 00000100:00100000:1.0:1788309430.752834:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309430.752842:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309430.752856:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210484224 00000100:00100000:3.0:1788309430.752864:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210484224 00000100:00100000:1.0:1788309430.752865:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788309430.752874:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8efc4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210484480:0@lo:400: 00000100:00100000:0.0:1788309430.752878:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788309430.752897:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8efc4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875178210484352:0@lo:400: 00000100:00100000:1.0:1788309430.752904:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309430.752920:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210484608 00000100:00100000:3.0:1788309430.752925:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210484608 00000100:00100000:0.0:1788309430.752934:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309430.752955:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210484352 00000100:00100000:3.0:1788309430.752959:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210484352 00000100:00100000:1.0:1788309430.752967:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788309430.752971:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210484736 00000100:00100000:0.0:1788309430.752976:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210484736 00000100:00100000:3.0:1788309430.752979:0:5839:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788309430.752981:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8efc4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875178210484224:12345-0@lo:400: 00000100:00100000:3.0:1788309430.752987:0:5839:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788309430.753000:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210484480 00000100:00100000:3.0:1788309430.753003:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210484096 00000100:00100000:0.0:1788309430.753003:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210484480 00000100:00100000:0.0:1788309430.753026:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788309430.753037:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8efc4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875178210484224:12345-0@lo:400: Request processed in 59us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309430.753037:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8efc4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875178210484736:12345-0@lo:400: 00000100:00100000:1.0:1788309430.753051:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788309430.753082:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788309430.753087:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8efc4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875178210484736:12345-0@lo:400: Request processed in 53us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309430.753095:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788309430.753110:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788309430.753117:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f4ce0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875178210484480:12345-0@lo:400: 00000100:00100000:0.0:1788309430.753149:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f4ce0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875178210484480:12345-0@lo:400: Request processed in 34us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309430.753154:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788309430.753191:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f4ce2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875178210484608:12345-0@lo:400: 00000100:00100000:0.0:1788309430.753215:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8efc4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875178210484224:0@lo:400: 00000100:00100000:1.0:1788309430.753235:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f4ce2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875178210484608:12345-0@lo:400: Request processed in 145us (400us total) trans 0 rc 0/0 00010000:00080000:0.0:1788309430.753238:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8efc4d500 x1875178210484736/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788309446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788309430.753245:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788309430.753258:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8efc4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875178210484736:0@lo:400: 00000100:00100000:1.0:1788309430.753265:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788309430.753273:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8efc4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875178210484352:12345-0@lo:400: 00010000:00080000:0.0:1788309430.753328:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8efc4ea00 x1875178210484480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788309446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788309430.753339:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8efc4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875178210484352:12345-0@lo:400: Request processed in 66us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309430.753351:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788309430.753363:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8efc4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210484480:0@lo:400: 00000100:00100000:3.0:1788309430.753376:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210484096 00000100:00100000:0.0:1788309430.753382:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8efc4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875178210484608:0@lo:400: 00000100:00100000:1.0:1788309430.753389:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8efc4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875178210484352:0@lo:400: 00000100:00100000:3.0:1788309430.753412:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00080000:0.0:1788309430.753414:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788309430.753418:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788309430.753420:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aeb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:3301:x1875178210484096:12345-0@lo:400: 00000100:00080000:0.0:1788309430.753421:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788309430.753458:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aeb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:3301:x1875178210484096:12345-0@lo:400: Request processed in 38us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309430.753464:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788309430.753470:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8efc4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3301:1875178210484096:0@lo:400: 00010000:00010000:1.0:1788309431.014745:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788309431.265574:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecf16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210484864:0@lo:13: 00000100:00100000:3.0:1788309431.265771:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309431.265937:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210484864 00000100:00100000:2.0:1788309431.265946:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210484864 00000100:00100000:2.0:1788309431.265996:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788309431.266006:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e667c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210484864:12345-0@lo:13: 00002000:00000024:2.0:1788309431.266039:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788309431.266087:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e667c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210484864:12345-0@lo:13: Request processed in 83us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309431.266094:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1788309431.266195:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8ecf16a00 x1875178210484864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788309447 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788309431.266209:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecf16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210484864:0@lo:13: 00000100:00100000:2.0:1788309431.776519:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8f4ce3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210484992:0@lo:13: 00000100:00100000:2.0:1788309431.776593:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309431.776762:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210484992 00000100:00100000:1.0:1788309431.776770:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210484992 00000100:00100000:1.0:1788309431.776827:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788309431.776837:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecf17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875178210484992:12345-0@lo:13: 00002000:00000024:1.0:1788309431.776935:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788309431.776985:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecf17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875178210484992:12345-0@lo:13: Request processed in 149us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309431.776992:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1788309431.777031:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8f4ce3480 x1875178210484992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788309447 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788309431.777052:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8f4ce3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210484992:0@lo:13: 00010000:00010000:3.0:1788309432.034825:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309433.056347:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788309433.729937:0:8442:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdae7c8bc0 20000000:00000080:1.0:1788309433.729968:0:8442:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff97c8e6902c00 uarg=0000000000000000 20000000:01000000:1.0:1788309433.730066:0:8442:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1788309433.730068:0:8442:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1788309433.730071:0:8442:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1788309433.730081:0:8442:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1788309433.730086:0:8442:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1788309433.730100:0:8442:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788309433.730103:0:8442:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788309433.732038:0:8442:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788309433.732047:0:8442:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788309433.738429:0:8443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:1.0:1788309433.742656:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:1.0:1788309433.742735:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:1.0:1788309433.742778:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:1.0:1788309433.742792:0:8442:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788309433.742795:0:8442:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788309433.755265:0:8444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:0.0:1788309433.766943:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:0.0:1788309433.767443:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:0.0:1788309433.767516:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:0.0:1788309433.767534:0:8442:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1788309433.767537:0:8442:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788309433.770345:0:8445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1788309433.772416:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1788309433.773707:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:0.0:1788309433.774089:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:0.0:1788309433.774111:0:8442:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788309433.774114:0:8442:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788309433.779252:0:8446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1788309433.780451:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1788309433.780536:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:2.0:1788309433.780572:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:2.0:1788309433.780719:0:8442:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788309433.780837:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97c8e26d9a00/0x63a04852f4628623 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309433.780861:0:8442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c8f5549600/0x63a04852f4628520 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f4628519 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309433.780870:0:8442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c8c153a600/0x63a04852f462854a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f4628543 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309433.780878:0:8442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c8c153b200/0x63a04852f4628574 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f462856d expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309433.780894:0:8442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c8f5548c00/0x63a04852f4628582 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f462857b expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309433.780901:0:8442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c8e26d8200/0x63a04852f4628590 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f4628589 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309433.780908:0:8442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c8d73ee200/0x63a04852f46285ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f46285a5 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309433.780916:0:8442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c8f5549400/0x63a04852f46285cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f46285c8 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309433.780927:0:8442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c8c153bc00/0x63a04852f46285e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a89c expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309433.780935:0:8442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c8c153a000/0x63a04852f46285eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a8a3 expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309433.780943:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97c8e26d9a00/0x63a04852f4628623 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309433.781148:0:8442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c8c153a000/0x63a04852f46285eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a8a3 expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309433.781166:0:8442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97c8c153a000/0x63a04852f46285eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a8a3 expref: 9 pid: 5832 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309433.781422:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecf15500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8442:1875178210485120:192.168.202.55@tcp:104: 00010000:00010000:2.0:1788309433.781543:0:8442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c8c153bc00/0x63a04852f46285e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a89c expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309433.781559:0:8442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97c8c153bc00/0x63a04852f46285e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a89c expref: 9 pid: 5830 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309433.781569:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecf14700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8442:1875178210485248:192.168.202.55@tcp:104: 00010000:00010000:2.0:1788309433.782355:0:8442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c8f5549400/0x63a04852f46285cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x63a04852f46285c8 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309433.782366:0:8442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97c8f5549400/0x63a04852f46285cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x63a04852f46285c8 expref: 18 pid: 5832 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309433.782376:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecf17b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8442:1875178210485376:0@lo:104: 00000100:00100000:3.0:1788309433.789089:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309433.789352:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192637952 00000100:00100000:1.0:1788309433.789363:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192637952 00010000:00010000:1.0:1788309433.789406:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c8c153a000/0x63a04852f46285eb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a8a3 expref: 10 pid: 5832 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309433.789448:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 12 00000100:00100000:1.0:1788309433.789459:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e667c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f8351692-8d1a-4b41-bdaf-bf179786ff59+10:2350:x1875178192637952:12345-192.168.202.55@tcp:103: 00010000:00010000:1.0:1788309433.789486:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788309433.789493:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c8c153a000/0x63a04852f46285eb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a8a3 expref: 10 pid: 5832 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309433.789506:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c8c153a000/0x63a04852f46285eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a8a3 expref: 10 pid: 5832 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309433.789525:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788309433.789573:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e667c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f8351692-8d1a-4b41-bdaf-bf179786ff59+10:2350:x1875178192637952:12345-192.168.202.55@tcp:103: Request processed in 116us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309433.789581:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 12 00000100:00100000:2.0:1788309433.791503:0:8442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788309433.791589:0:8442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c8d73ee200/0x63a04852f46285ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x63a04852f46285a5 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309433.791604:0:8442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97c8d73ee200/0x63a04852f46285ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x63a04852f46285a5 expref: 18 pid: 5832 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309433.791618:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecf16300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8442:1875178210485504:0@lo:104: 00000100:00100000:2.0:1788309433.791658:0:8442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788309433.791691:0:8442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c8e26d8200/0x63a04852f4628590 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x63a04852f4628589 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309433.791700:0:8442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97c8e26d8200/0x63a04852f4628590 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x63a04852f4628589 expref: 18 pid: 5831 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309433.791708:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecf15c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8442:1875178210485632:0@lo:104: 00010000:00010000:2.0:1788309433.791731:0:8442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c8f5548c00/0x63a04852f4628582 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x63a04852f462857b expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309433.791752:0:8442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97c8f5548c00/0x63a04852f4628582 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x63a04852f462857b expref: 18 pid: 5832 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309433.792160:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788309433.792868:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecf15880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8442:1875178210485760:0@lo:104: 00010000:00010000:2.0:1788309433.792925:0:8442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c8c153b200/0x63a04852f4628574 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x63a04852f462856d expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309433.792936:0:8442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97c8c153b200/0x63a04852f4628574 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x63a04852f462856d expref: 18 pid: 5830 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309433.792958:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecf14a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8442:1875178210485888:0@lo:104: 00010000:00010000:2.0:1788309433.792986:0:8442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c8c153a600/0x63a04852f462854a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x63a04852f4628543 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309433.792994:0:8442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97c8c153a600/0x63a04852f462854a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x63a04852f4628543 expref: 18 pid: 5832 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309433.793001:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecf15180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8442:1875178210486016:0@lo:104: 00010000:00010000:2.0:1788309433.793025:0:8442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c8f5549600/0x63a04852f4628520 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x63a04852f4628519 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309433.793032:0:8442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97c8f5549600/0x63a04852f4628520 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x63a04852f4628519 expref: 18 pid: 5832 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309433.793041:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecf15f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8442:1875178210486144:0@lo:104: 00000100:00100000:2.0:1788309433.793059:0:8442:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8ffbdd9c0 going to sleep for 11 seconds 00010000:00010000:2.0:1788309433.793090:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c8c153a000/0x63a04852f46285eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a8a3 expref: 9 pid: 5832 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309433.793095:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309433.793111:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309433.793120:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecf15500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8442:1875178210485120:192.168.202.55@tcp:104: 00000100:00100000:1.0:1788309433.793120:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309433.793154:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309433.793168:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309433.793238:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210485376 00000100:00100000:1.0:1788309433.793246:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210485376 00000100:00100000:1.0:1788309433.793302:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210485504 00000100:00100000:1.0:1788309433.793306:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210485504 00000100:00100000:1.0:1788309433.793319:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210485632 00000100:00100000:1.0:1788309433.793321:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210485632 00000100:00100000:1.0:1788309433.793330:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210485760 00000100:00100000:1.0:1788309433.793333:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210485760 00000100:00100000:1.0:1788309433.793342:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210485888 00000100:00100000:1.0:1788309433.793345:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210485888 00000100:00100000:1.0:1788309433.793355:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210486016 00000100:00100000:1.0:1788309433.793358:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210486016 00000100:00100000:1.0:1788309433.793366:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210486144 00000100:00100000:1.0:1788309433.793369:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210486144 00000100:00100000:1.0:1788309433.793382:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788309433.793392:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecf14000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+9:8442:x1875178210485376:12345-0@lo:104: 00010000:00010000:1.0:1788309433.793405:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8a00/0x63a04852f46285c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x63a04852f46285cf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309433.793463:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788309433.793470:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecf14000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+9:8442:x1875178210485376:12345-0@lo:104: Request processed in 80us (1974us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309433.794117:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788309433.794206:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00010000:00010000:3.0:1788309433.794227:0:7627:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788309433.794234:0:7627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8a00/0x63a04852f46285c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x63a04852f46285cf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309433.794242:0:7627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d8a00 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:3.0:1788309433.794246:0:7627:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8a00/0x63a04852f46285c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x63a04852f46285cf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309433.794254:0:7627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8a00/0x63a04852f46285c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x63a04852f46285cf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788309433.794261:0:7627:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8a00/0x63a04852f46285c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x63a04852f46285cf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788309433.794267:0:7627:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788309433.794374:0:7627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8a00/0x63a04852f46285c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f46285cf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309433.794381:0:7627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788309433.794401:0:7627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8a00/0x63a04852f46285c8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f46285cf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309433.794408:0:7627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8a00/0x63a04852f46285c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f46285cf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309433.794421:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309433.794423:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309433.794425:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788309433.794453:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192638080 00000100:00100000:1.0:1788309433.794461:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788309433.794463:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192638080 00000100:00100000:1.0:1788309433.794470:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d682c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+8:8442:x1875178210485504:12345-0@lo:104: 00010000:00010000:3.0:1788309433.794495:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c8c153bc00/0x63a04852f46285e4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a89c expref: 9 pid: 5830 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309433.794520:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 13 00000100:00100000:3.0:1788309433.794527:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e667e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f8351692-8d1a-4b41-bdaf-bf179786ff59+9:2350:x1875178192638080:12345-192.168.202.55@tcp:103: 00010000:00010000:3.0:1788309433.794539:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788309433.794545:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c8c153bc00/0x63a04852f46285e4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a89c expref: 9 pid: 5830 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309433.794556:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c8c153bc00/0x63a04852f46285e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a89c expref: 9 pid: 5830 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309433.794572:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788309433.794611:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e667e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f8351692-8d1a-4b41-bdaf-bf179786ff59+9:2350:x1875178192638080:12345-192.168.202.55@tcp:103: Request processed in 85us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309433.794618:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 13 00000100:00100000:3.0:1788309433.794649:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e6979500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3301:1875178210486272:0@lo:103: 00010000:00010000:1.0:1788309433.794674:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff97c8c153ac00/0x63a04852f46285a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x63a04852f46285ac expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309433.794680:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788309433.794715:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788309433.794718:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210486272 00000100:00100000:3.0:1788309433.794721:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210486272 00010000:00010000:3.0:1788309433.794735:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c8f5549400/0x63a04852f46285cf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63a04852f46285c8 expref: 19 pid: 5832 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309433.794755:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788309433.794761:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6978700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:3301:x1875178210486272:12345-0@lo:103: 00010000:00010000:3.0:1788309433.794769:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788309433.794773:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c8f5549400/0x63a04852f46285cf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63a04852f46285c8 expref: 19 pid: 5832 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309433.794789:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c8f5549400/0x63a04852f46285cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x63a04852f46285c8 expref: 19 pid: 5832 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309433.794801:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788309433.794825:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6978700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:3301:x1875178210486272:12345-0@lo:103: Request processed in 65us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309433.794831:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788309433.794860:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e6979500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3301:1875178210486272:0@lo:103: 00000100:00100000:1.0:1788309433.796292:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d682c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+8:8442:x1875178210485504:12345-0@lo:104: Request processed in 254us (3063us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309433.796305:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788309433.796360:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788309433.796374:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f4ce3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+7:8442:x1875178210485632:12345-0@lo:104: 00010000:00010000:1.0:1788309433.796386:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8000/0x63a04852f4628589 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x63a04852f4628590 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309433.796452:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788309433.796458:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f4ce3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+7:8442:x1875178210485632:12345-0@lo:104: Request processed in 91us (3364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309433.796464:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788309433.796490:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788309433.796497:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f4ce0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+6:8442:x1875178210485760:12345-0@lo:104: 00010000:00010000:1.0:1788309433.796504:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff97c8e26d9600/0x63a04852f462857b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x63a04852f4628582 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309433.796540:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788309433.796546:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f4ce0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+6:8442:x1875178210485760:12345-0@lo:104: Request processed in 50us (3433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309433.796552:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788309433.796567:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788309433.796573:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f4ce0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+5:8442:x1875178210485888:12345-0@lo:104: 00010000:00010000:1.0:1788309433.796581:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8c00/0x63a04852f462856d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x63a04852f4628574 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309433.796626:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788309433.796631:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f4ce0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+5:8442:x1875178210485888:12345-0@lo:104: Request processed in 59us (3510us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309433.796637:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788309433.796651:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788309433.796658:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecdc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+4:8442:x1875178210486016:12345-0@lo:104: 00010000:00010000:1.0:1788309433.796665:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff97c8f5548000/0x63a04852f4628543 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x63a04852f462854a expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309433.796691:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1788309433.796696:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecdc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+4:8442:x1875178210486016:12345-0@lo:104: Request processed in 40us (3542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309433.796702:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788309433.796714:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788309433.796720:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecdc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+3:8442:x1875178210486144:12345-0@lo:104: 00010000:00010000:1.0:1788309433.796728:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff97c9021e4200/0x63a04852f4628519 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x63a04852f4628520 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309433.796750:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1788309433.796755:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecdc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+3:8442:x1875178210486144:12345-0@lo:104: Request processed in 36us (3587us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309433.796760:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1788309433.796782:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1788309433.796788:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff97c8c153ac00/0x63a04852f46285a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x63a04852f46285ac expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309433.796795:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8c153ac00 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:1.0:1788309433.796805:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff97c8c153ac00/0x63a04852f46285a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x63a04852f46285ac expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309433.796813:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff97c8c153ac00/0x63a04852f46285a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x63a04852f46285ac expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788309433.796820:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff97c8c153ac00/0x63a04852f46285a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x63a04852f46285ac expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788309433.796826:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788309433.796857:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff97c8c153ac00/0x63a04852f46285a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f46285ac expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309433.796863:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788309433.796884:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff97c8c153ac00/0x63a04852f46285a5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f46285ac expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309433.796891:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff97c8c153ac00/0x63a04852f46285a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f46285ac expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309433.796905:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788309433.796909:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8000/0x63a04852f4628589 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x63a04852f4628590 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309433.796915:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d8000 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:1.0:1788309433.796917:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8000/0x63a04852f4628589 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x63a04852f4628590 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309433.796923:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8000/0x63a04852f4628589 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x63a04852f4628590 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788309433.796939:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8000/0x63a04852f4628589 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x63a04852f4628590 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788309433.796944:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788309433.796968:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8000/0x63a04852f4628589 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f4628590 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309433.796973:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788309433.796979:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8000/0x63a04852f4628589 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f4628590 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309433.796985:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8000/0x63a04852f4628589 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f4628590 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309433.796997:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788309433.797000:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff97c8e26d9600/0x63a04852f462857b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x63a04852f4628582 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309433.797005:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d9600 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:1.0:1788309433.797008:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff97c8e26d9600/0x63a04852f462857b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x63a04852f4628582 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309433.797014:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff97c8e26d9600/0x63a04852f462857b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x63a04852f4628582 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788309433.797021:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff97c8e26d9600/0x63a04852f462857b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x63a04852f4628582 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788309433.797026:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788309433.797044:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff97c8e26d9600/0x63a04852f462857b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f4628582 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309433.797049:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788309433.797061:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff97c8e26d9600/0x63a04852f462857b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f4628582 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309433.797067:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff97c8e26d9600/0x63a04852f462857b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f4628582 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309433.797076:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788309433.797079:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8c00/0x63a04852f462856d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x63a04852f4628574 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309433.797084:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d8c00 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:1.0:1788309433.797087:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8c00/0x63a04852f462856d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x63a04852f4628574 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309433.797092:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8c00/0x63a04852f462856d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x63a04852f4628574 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788309433.797098:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8c00/0x63a04852f462856d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x63a04852f4628574 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788309433.797103:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788309433.797114:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8c00/0x63a04852f462856d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f4628574 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309433.797120:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788309433.797125:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8c00/0x63a04852f462856d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f4628574 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309433.797140:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8c00/0x63a04852f462856d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f4628574 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309433.797148:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788309433.797151:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff97c8f5548000/0x63a04852f4628543 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x63a04852f462854a expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309433.797156:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8f5548000 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:1.0:1788309433.797159:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff97c8f5548000/0x63a04852f4628543 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x63a04852f462854a expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309433.797165:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff97c8f5548000/0x63a04852f4628543 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x63a04852f462854a expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788309433.797170:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff97c8f5548000/0x63a04852f4628543 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x63a04852f462854a expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309433.798148:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788309433.798157:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff97c9021e4200/0x63a04852f4628519 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x63a04852f4628520 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309433.798165:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c9021e4200 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:3.0:1788309433.798169:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff97c9021e4200/0x63a04852f4628519 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x63a04852f4628520 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309433.798176:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff97c9021e4200/0x63a04852f4628519 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x63a04852f4628520 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788309433.798182:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff97c9021e4200/0x63a04852f4628519 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x63a04852f4628520 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788309433.798187:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788309433.798213:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff97c9021e4200/0x63a04852f4628519 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f4628520 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309433.798218:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788309433.798224:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff97c9021e4200/0x63a04852f4628519 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f4628520 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309433.798243:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff97c9021e4200/0x63a04852f4628519 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f4628520 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309433.798257:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309433.798259:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309433.798261:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309433.798269:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788309433.798322:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecdc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3303:1875178210486528:0@lo:103: 00000100:00100000:3.0:1788309433.798380:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309433.798422:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788309433.798428:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecdc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3303:1875178210486400:0@lo:103: 00000100:00100000:3.0:1788309433.798447:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309433.798463:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e6979500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3303:1875178210486912:0@lo:103: 00000100:00100000:3.0:1788309433.798492:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309433.798515:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecdc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3300:1875178210486656:0@lo:103: 00000100:00100000:3.0:1788309433.798541:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309433.798552:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788309433.798557:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecdc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3300:1875178210486784:0@lo:103: 00000100:00100000:3.0:1788309433.798575:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:1.0:1788309433.798594:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1788309433.798602:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210486528 00000100:00100000:3.0:1788309433.798609:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210486528 00010000:00010000:1.0:1788309433.798616:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff97c8f5548000/0x63a04852f4628543 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f462854a expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309433.798621:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788309433.798630:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff97c8f5548000/0x63a04852f4628543 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f462854a expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309433.798636:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c8e26d8200/0x63a04852f4628590 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63a04852f4628589 expref: 19 pid: 5831 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309433.798636:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff97c8f5548000/0x63a04852f4628543 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f462854a expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309433.798650:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788309433.798654:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210486400 00000100:00100000:3.0:1788309433.798657:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210486400 00010000:00010000:1.0:1788309433.798657:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309433.798659:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309433.798666:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309433.798667:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c8d73ee200/0x63a04852f46285ac lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63a04852f46285a5 expref: 20 pid: 5832 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309433.798683:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210486912 00000100:00100000:3.0:1788309433.798686:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210486912 00010000:00010000:3.0:1788309433.798697:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c8f5549600/0x63a04852f4628520 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63a04852f4628519 expref: 21 pid: 5832 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309433.798707:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210486656 00000100:00100000:3.0:1788309433.798709:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210486656 00010000:00010000:3.0:1788309433.798718:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c8f5548c00/0x63a04852f4628582 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63a04852f462857b expref: 22 pid: 5832 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309433.798728:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210486784 00000100:00100000:3.0:1788309433.798730:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210486784 00010000:00010000:3.0:1788309433.798738:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c8c153b200/0x63a04852f4628574 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63a04852f462856d expref: 23 pid: 5830 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309433.798749:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788309433.798756:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e697bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+23:3303:x1875178210486528:12345-0@lo:103: 00010000:00010000:3.0:1788309433.798767:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788309433.798772:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c8e26d8200/0x63a04852f4628590 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63a04852f4628589 expref: 23 pid: 5831 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309433.798781:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c8e26d8200/0x63a04852f4628590 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x63a04852f4628589 expref: 23 pid: 5831 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309433.798796:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788309433.798822:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e697bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+23:3303:x1875178210486528:12345-0@lo:103: Request processed in 66us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309433.798829:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788309433.798846:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788309433.798859:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6978000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+22:3303:x1875178210486400:12345-0@lo:103: 00010000:00010000:3.0:1788309433.798867:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788309433.798871:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c8d73ee200/0x63a04852f46285ac lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63a04852f46285a5 expref: 22 pid: 5832 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309433.798880:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c8d73ee200/0x63a04852f46285ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x63a04852f46285a5 expref: 22 pid: 5832 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309433.798889:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788309433.798909:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6978000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+22:3303:x1875178210486400:12345-0@lo:103: Request processed in 52us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309433.798914:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788309433.798925:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788309433.798930:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e697a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+21:3303:x1875178210486912:12345-0@lo:103: 00010000:00010000:3.0:1788309433.798938:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788309433.801386:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c8c153bc00/0x63a04852f46285e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a89c expref: 8 pid: 5830 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309433.801407:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecf14700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8442:1875178210485248:192.168.202.55@tcp:104: 00010000:00010000:2.0:1788309433.801421:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c8f5549400/0x63a04852f46285cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x63a04852f46285c8 expref: 21 pid: 5832 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309433.801429:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecf17b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8442:1875178210485376:0@lo:104: 00010000:00010000:2.0:1788309433.801438:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c8d73ee200/0x63a04852f46285ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x63a04852f46285a5 expref: 20 pid: 5832 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309433.801447:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecf16300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8442:1875178210485504:0@lo:104: 00010000:00010000:2.0:1788309433.801456:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c8e26d8200/0x63a04852f4628590 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x63a04852f4628589 expref: 19 pid: 5831 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309433.801466:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecf15c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8442:1875178210485632:0@lo:104: 00000100:00100000:2.0:1788309433.801488:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecf15880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8442:1875178210485760:0@lo:104: 00000100:00100000:2.0:1788309433.801498:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecf14a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8442:1875178210485888:0@lo:104: 00000100:00100000:2.0:1788309433.801505:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecf15180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8442:1875178210486016:0@lo:104: 00000100:00100000:2.0:1788309433.801514:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecf15f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8442:1875178210486144:0@lo:104: 00010000:00010000:2.0:1788309433.801547:0:8442:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97c8e26d9a00/0x63a04852f4628623 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309433.802095:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c8f5549600/0x63a04852f4628520 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63a04852f4628519 expref: 18 pid: 5832 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309433.802109:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c8f5549600/0x63a04852f4628520 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x63a04852f4628519 expref: 18 pid: 5832 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309433.802128:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c8f5549600/0x63a04852f4628520 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x63a04852f4628519 expref: 18 pid: 5832 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309433.802142:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788309433.802217:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e697a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+17:3303:x1875178210486912:12345-0@lo:103: Request processed in 3285us (3723us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309433.802226:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788309433.802258:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788309433.802379:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6b28450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+16:3300:x1875178210486656:12345-0@lo:103: 00010000:00010000:3.0:1788309433.802395:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788309433.802401:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c8f5548c00/0x63a04852f4628582 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63a04852f462857b expref: 16 pid: 5832 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309433.802411:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c8f5548c00/0x63a04852f4628582 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x63a04852f462857b expref: 16 pid: 5832 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309433.802422:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c8f5548c00/0x63a04852f4628582 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x63a04852f462857b expref: 16 pid: 5832 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309433.802431:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788309433.802484:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6b28450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+15:3300:x1875178210486656:12345-0@lo:103: Request processed in 111us (3941us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309433.802512:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecdc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3300:1875178210486656:0@lo:103: 00000100:00100000:0.0:1788309433.803113:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788309433.803132:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecdc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3302:1875178210487040:0@lo:103: 00000100:00100000:0.0:1788309433.803178:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309433.809458:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788309433.809514:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6979c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+15:3300:x1875178210486784:12345-0@lo:103: 00010000:00010000:2.0:1788309433.809539:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788309433.809550:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c8c153b200/0x63a04852f4628574 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63a04852f462856d expref: 15 pid: 5830 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309433.809569:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c8c153b200/0x63a04852f4628574 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x63a04852f462856d expref: 15 pid: 5830 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309433.809592:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c8c153b200/0x63a04852f4628574 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x63a04852f462856d expref: 15 pid: 5830 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309433.809611:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788309433.809717:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6979c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+14:3300:x1875178210486784:12345-0@lo:103: Request processed in 216us (11139us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309433.809727:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788309433.809763:0:5821:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788309433.809772:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1788309433.809812:0:5823:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788309433.809820:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210487040 00000100:00100000:2.0:1788309433.809828:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210487040 00010000:00010000:2.0:1788309433.809853:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c8c153a600/0x63a04852f462854a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63a04852f4628543 expref: 14 pid: 5832 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309433.809870:0:5823:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788309433.809877:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788309433.809883:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8efc4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+14:3302:x1875178210487040:12345-0@lo:103: 00010000:00010000:2.0:1788309433.809891:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788309433.809896:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c8c153a600/0x63a04852f462854a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63a04852f4628543 expref: 14 pid: 5832 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309433.809916:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c8c153a600/0x63a04852f462854a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x63a04852f4628543 expref: 14 pid: 5832 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309433.809927:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c8c153a600/0x63a04852f462854a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x63a04852f4628543 expref: 14 pid: 5832 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309433.809952:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97c8e26d9a00/0x63a04852f4628623 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309433.809961:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8e26d9a00/0x63a04852f4628623 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309433.809975:0:5823:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97c8e26d9a00/0x63a04852f4628623 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309433.809982:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97c8e26d9a00/0x63a04852f4628623 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309433.809988:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97c8e26d9a00/0x63a04852f4628623 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309433.809996:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97c8e26d9a00/0x63a04852f4628623 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309433.810002:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d9a00 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:2.0:1788309433.810006:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97c8e26d9a00/0x63a04852f4628623 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309433.810014:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97c8e26d9a00/0x63a04852f4628623 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309433.810048:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97c8e26d9a00/0x63a04852f4628623 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309433.810058:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788309433.810088:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8efc4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+13:3302:x1875178210487040:12345-0@lo:103: Request processed in 206us (6910us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309433.810095:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:2.0:1788309433.810117:0:8442:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97c8e26d9a00/0x63a04852f4628623 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309433.810125:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97c8e26d9a00/0x63a04852f4628623 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309433.810130:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c8e26d9a00/0x63a04852f4628623 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309433.810494:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecdc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3300:1875178210486784:0@lo:103: 00000100:00100000:0.0:1788309433.811137:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecdc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3302:1875178210487040:0@lo:103: 00000100:00100000:3.0:1788309433.815037:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788309433.815127:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecdc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3303:1875178210486400:0@lo:103: 00000100:00100000:3.0:1788309433.815138:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e6979500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3303:1875178210486912:0@lo:103: 00000100:00100000:3.0:1788309433.815147:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecdc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3303:1875178210486528:0@lo:103: 00010000:00010000:0.0:1788309434.081398:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788309434.503745:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309434.504239:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192638208 00000100:00100000:2.0:1788309434.504251:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192638208 00000100:00100000:2.0:1788309434.504383:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 131 00000100:00100000:2.0:1788309434.504395:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6ae9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8351692-8d1a-4b41-bdaf-bf179786ff59+8:5592:x1875178192638208:12345-192.168.202.55@tcp:101: 00010000:00010000:2.0:1788309434.504423:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309434.504446:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c8e26d8200/0x63a04852f462862a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8a28c761146a905 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309434.504488:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8e26d8200/0x63a04852f462862a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a905 expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309434.504499:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c8e26d8200/0x63a04852f462862a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a905 expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309434.504533:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8e26d8200, rc 0) 00000100:00100000:2.0:1788309434.504610:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6ae9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8351692-8d1a-4b41-bdaf-bf179786ff59+9:5592:x1875178192638208:12345-192.168.202.55@tcp:101: Request processed in 218us (876us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309434.504617:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 131 00000100:00100000:3.0:1788309434.510600:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309434.513010:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192638336 00000100:00100000:0.0:1788309434.513026:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192638336 00000100:00100000:0.0:1788309434.513258:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 132 00000100:00100000:0.0:1788309434.513270:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8351692-8d1a-4b41-bdaf-bf179786ff59+9:5592:x1875178192638336:12345-192.168.202.55@tcp:501: 00000100:00100000:0.0:1788309434.513680:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8351692-8d1a-4b41-bdaf-bf179786ff59+9:5592:x1875178192638336:12345-192.168.202.55@tcp:501: Request processed in 410us (3103us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309434.513689:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 132 00000100:00100000:1.0:1788309434.519059:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309434.519253:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192638464 00000100:00100000:2.0:1788309434.519265:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192638464 00000100:00100000:2.0:1788309434.519408:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 133 00000100:00100000:2.0:1788309434.519640:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8351692-8d1a-4b41-bdaf-bf179786ff59+9:5592:x1875178192638464:12345-192.168.202.55@tcp:503: 00000100:00100000:2.0:1788309434.520095:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8351692-8d1a-4b41-bdaf-bf179786ff59+9:5592:x1875178192638464:12345-192.168.202.55@tcp:503: Request processed in 518us (1045us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309434.520104:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 133 00000100:00100000:1.0:1788309434.528073:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309434.528718:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192638592 00000100:00100000:0.0:1788309434.528729:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192638592 00000100:00100000:0.0:1788309434.528799:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 134 00000100:00100000:0.0:1788309434.528810:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6ae9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8351692-8d1a-4b41-bdaf-bf179786ff59+9:6058:x1875178192638592:12345-192.168.202.55@tcp:502: 00000100:00100000:0.0:1788309434.529357:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6ae9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8351692-8d1a-4b41-bdaf-bf179786ff59+9:6058:x1875178192638592:12345-192.168.202.55@tcp:502: Request processed in 547us (1300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309434.529365:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 134 00000100:00100000:3.0:1788309434.537400:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309434.540740:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192638720 00000100:00100000:2.0:1788309434.540754:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192638720 00000100:00100000:2.0:1788309434.540973:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 135 00000100:00100000:2.0:1788309434.540985:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8351692-8d1a-4b41-bdaf-bf179786ff59+9:6058:x1875178192638720:12345-192.168.202.55@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788309434.541329:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8351692-8d1a-4b41-bdaf-bf179786ff59+9:6058:x1875178192638720:12345-192.168.202.55@tcp:502:llog_process_th.0 Request processed in 345us (3936us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309434.541338:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 135 00000100:00100000:3.0:1788309434.548012:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309434.548159:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192638848 00000100:00100000:0.0:1788309434.548169:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192638848 00000100:00100000:0.0:1788309434.548226:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 136 00000100:00100000:0.0:1788309434.548236:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8351692-8d1a-4b41-bdaf-bf179786ff59+9:5592:x1875178192638848:12345-192.168.202.55@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788309434.548253:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788309434.548308:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c8d73eec00/0x63a04852f4628631 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8a28c761146a90c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309434.548338:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8d73eec00/0x63a04852f4628631 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a90c expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309434.548350:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c8d73eec00/0x63a04852f4628631 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a90c expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309434.548359:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8d73eec00, rc 0) 00000100:00100000:0.0:1788309434.548429:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8351692-8d1a-4b41-bdaf-bf179786ff59+10:5592:x1875178192638848:12345-192.168.202.55@tcp:101:ll_cfg_requeue.0 Request processed in 180us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309434.548452:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 136 00000100:00100000:1.0:1788309434.552849:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309434.553029:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192638976 00000100:00100000:2.0:1788309434.553044:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192638976 00000100:00100000:2.0:1788309434.553106:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 137 00000100:00100000:2.0:1788309434.553119:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8351692-8d1a-4b41-bdaf-bf179786ff59+10:5592:x1875178192638976:12345-192.168.202.55@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788309434.553451:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8351692-8d1a-4b41-bdaf-bf179786ff59+10:5592:x1875178192638976:12345-192.168.202.55@tcp:501:ll_cfg_requeue.0 Request processed in 334us (629us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788309434.553478:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 137 10000000:01000000:3.0:1788309435.054491:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788309435.054500:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97c8f519c800 from 39 10000000:01000000:3.0:1788309435.054506:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788309435.054578:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8c153a400/0x63a04852f4628638 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309435.054608:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff97c8c153a400/0x63a04852f4628638 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309435.054622:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff97c8c153a400/0x63a04852f4628638 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309435.054649:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e6979500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210487168:0@lo:101: 00000100:00100000:3.0:1788309435.054741:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309435.054830:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8fc91aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788309435.057010:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210487168 00000100:00100000:0.0:1788309435.057031:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210487168 00000100:00100000:0.0:1788309435.057112:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788309435.057134:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+12:5834:x1875178210487168:12345-0@lo:101: 00010000:00010000:0.0:1788309435.057150:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788309435.057170:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c8d73ef600/0x63a04852f462863f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x63a04852f4628638 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309435.057198:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8d73ef600/0x63a04852f462863f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63a04852f4628638 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309435.057210:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c8d73ef600/0x63a04852f462863f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f4628638 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309435.057220:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8d73ef600, rc 0) 00000100:00100000:0.0:1788309435.058443:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+13:5834:x1875178210487168:12345-0@lo:101: Request processed in 1314us (3696us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309435.058453:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788309435.059140:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e6979500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210487168:0@lo:101: 00010000:00010000:3.0:1788309435.059167:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff97c8c153a400/0x63a04852f4628638 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f462863f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309435.059180:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff97c8c153a400/0x63a04852f4628638 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x63a04852f462863f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309435.059256:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e6979500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210487296:0@lo:501: 00000100:00100000:3.0:1788309435.059351:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309435.059381:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8fc91aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788309435.060809:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210487296 00000100:00100000:0.0:1788309435.060834:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210487296 00000100:00100000:0.0:1788309435.061022:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788309435.061034:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+13:5834:x1875178210487296:12345-0@lo:501: 00000100:00100000:0.0:1788309435.061432:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+13:5834:x1875178210487296:12345-0@lo:501: Request processed in 390us (2070us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309435.061440:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788309435.062804:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e6979500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210487296:0@lo:501: 00000100:00100000:3.0:1788309435.062884:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e6979500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210487424:0@lo:503: 00000100:00100000:3.0:1788309435.062970:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309435.088272:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8fc91aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788309435.088700:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210487424 00000100:00100000:0.0:1788309435.088731:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210487424 00000100:00100000:0.0:1788309435.088792:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788309435.088806:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+13:5834:x1875178210487424:12345-0@lo:503: 00000100:00100000:0.0:1788309435.089139:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+13:5834:x1875178210487424:12345-0@lo:503: Request processed in 334us (26167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309435.089149:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788309435.089221:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e6979500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210487424:0@lo:503: 00000100:00100000:0.0:1788309435.089537:0:8461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8efc4f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:8461:1875178210487552:0@lo:502: 00000100:00100000:0.0:1788309435.090155:0:8461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309435.090193:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210487552 00000100:00100000:0.0:1788309435.090198:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210487552 00000100:00100000:0.0:1788309435.090227:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788309435.090234:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+13:8461:x1875178210487552:12345-0@lo:502: 00000100:00100000:0.0:1788309435.091231:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+13:8461:x1875178210487552:12345-0@lo:502: Request processed in 990us (1069us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309435.091242:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788309435.091338:0:8461:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8e0686480 going to sleep for 11 seconds 00000100:00100000:0.0:1788309435.091361:0:8461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8efc4f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:8461:1875178210487552:0@lo:502: 00000100:00100000:0.0:1788309435.091419:0:8461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8efc4f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:8461:1875178210487680:0@lo:502: 00000100:00100000:0.0:1788309435.091476:0:8461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309435.091504:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210487680 00000100:00100000:0.0:1788309435.091509:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210487680 00000100:00100000:0.0:1788309435.091535:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788309435.091543:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+13:8461:x1875178210487680:12345-0@lo:502: 00000100:00100000:0.0:1788309435.094603:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+13:8461:x1875178210487680:12345-0@lo:502: Request processed in 3051us (3118us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309435.094635:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788309435.094716:0:8461:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8e0686480 going to sleep for 11 seconds 00000100:00100000:0.0:1788309435.094742:0:8461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8efc4f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:8461:1875178210487680:0@lo:502: 00000040:00080000:0.0:1788309435.094782:0:8461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788309435.099150:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1788309435.099197:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788309435.099212:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8c153a400/0x63a04852f4628638 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f462863f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309435.099243:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff97c8c153a400/0x63a04852f4628638 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f462863f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788309435.099255:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1788309435.099258:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1788309435.099261:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788309435.099333:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8c153b800/0x63a04852f4628646 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309435.099342:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff97c8c153b800/0x63a04852f4628646 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309435.099354:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff97c8c153b800/0x63a04852f4628646 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309435.099379:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e6978700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210487808:0@lo:101: 00000100:00100000:3.0:1788309435.099452:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309435.099515:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8fc91a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788309435.099660:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210487808 00000100:00100000:0.0:1788309435.099669:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210487808 00000100:00100000:0.0:1788309435.099715:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788309435.099728:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+13:5834:x1875178210487808:12345-0@lo:101: 00010000:00010000:0.0:1788309435.099745:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788309435.099759:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c8d73efa00/0x63a04852f462864d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x63a04852f4628646 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309435.099785:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8d73efa00/0x63a04852f462864d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63a04852f4628646 expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309435.099796:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c8d73efa00/0x63a04852f462864d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f4628646 expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309435.099805:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8d73efa00, rc 0) 00000100:00100000:0.0:1788309435.104309:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+14:5834:x1875178210487808:12345-0@lo:101: Request processed in 4574us (4848us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309435.104322:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788309435.106009:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e6978700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210487808:0@lo:101: 00010000:00010000:2.0:1788309435.106045:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff97c8c153b800/0x63a04852f4628646 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f462864d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309435.106060:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff97c8c153b800/0x63a04852f4628646 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x63a04852f462864d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309435.106204:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecf15f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210487936:0@lo:501: 00000100:00100000:2.0:1788309435.106260:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309435.106553:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8ffbdd780 going to sleep for 11 seconds 00000100:00100000:3.0:1788309435.107479:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210487936 00000100:00100000:3.0:1788309435.107490:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210487936 00000100:00100000:3.0:1788309435.107554:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788309435.107565:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+14:5834:x1875178210487936:12345-0@lo:501: 00000100:00100000:3.0:1788309435.107921:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+14:5834:x1875178210487936:12345-0@lo:501: Request processed in 356us (1658us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309435.107949:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00010000:00010000:0.0:1788309435.109517:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788309435.110476:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecf15f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210487936:0@lo:501: 00000100:00100000:2.0:1788309435.110544:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecf15f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210488064:0@lo:503: 00000100:00100000:2.0:1788309435.110644:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309435.110691:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8ffbdd780 going to sleep for 11 seconds 00000100:00100000:2.0:1788309435.110716:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210488064 00000100:00100000:2.0:1788309435.110722:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210488064 00000100:00100000:2.0:1788309435.110783:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788309435.110793:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+14:5834:x1875178210488064:12345-0@lo:503: 00000100:00100000:1.0:1788309435.111620:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+14:5834:x1875178210488064:12345-0@lo:503: Request processed in 825us (972us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309435.111632:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788309435.112086:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecf15f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210488064:0@lo:503: 00000100:00100000:3.0:1788309435.114614:0:8462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e697bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:8462:1875178210488192:0@lo:502: 00000100:00100000:3.0:1788309435.114714:0:8462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309435.114834:0:8462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8fc91a300 going to sleep for 11 seconds 00000100:00100000:1.0:1788309435.117317:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210488192 00000100:00100000:1.0:1788309435.117333:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210488192 00000100:00100000:1.0:1788309435.117404:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788309435.117417:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+14:8462:x1875178210488192:12345-0@lo:502: 00000100:00100000:1.0:1788309435.118436:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+14:8462:x1875178210488192:12345-0@lo:502: Request processed in 1017us (3716us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309435.118446:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788309435.118756:0:8462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e697bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:8462:1875178210488192:0@lo:502: 00000020:01000000:3.0:1788309435.118809:0:8462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788309435.119067:0:8462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788309435.119070:0:8462:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788309435.119080:0:8462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788309435.119190:0:8462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e697bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:8462:1875178210488320:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788309435.119258:0:8462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309435.119586:0:8462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8fc91a300 going to sleep for 11 seconds 00000100:00100000:0.0:1788309435.120317:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210488320 00000100:00100000:0.0:1788309435.120327:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210488320 00000100:00100000:0.0:1788309435.120390:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788309435.120402:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+14:8462:x1875178210488320:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788309435.121459:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+14:8462:x1875178210488320:12345-0@lo:502:llog_process_th.0 Request processed in 1055us (2197us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309435.121486:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788309435.121741:0:8462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e697bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:8462:1875178210488320:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788309435.121779:0:8462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788309435.121786:0:8462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788309435.121789:0:8462:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788309435.121794:0:8462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1788309435.122251:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1788309435.122271:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788309435.122312:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8c153b800/0x63a04852f4628646 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f462864d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309435.122324:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff97c8c153b800/0x63a04852f4628646 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f462864d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788309435.122335:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788309435.122337:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97c8d6805000 from 39 10000000:01000000:3.0:1788309435.122340:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788309435.122374:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8c153ba00/0x63a04852f4628654 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309435.122381:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff97c8c153ba00/0x63a04852f4628654 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309435.122391:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff97c8c153ba00/0x63a04852f4628654 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309435.122410:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e6978000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210488448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788309435.122482:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309435.122514:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8fc91a480 going to sleep for 11 seconds 00000100:00100000:0.0:1788309435.122739:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210488448 00000100:00100000:0.0:1788309435.122745:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210488448 00000100:00100000:0.0:1788309435.122784:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788309435.122792:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+14:5834:x1875178210488448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788309435.122805:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788309435.122832:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c8d73ee600/0x63a04852f462865b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x63a04852f4628654 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309435.122855:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8d73ee600/0x63a04852f462865b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63a04852f4628654 expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309435.122865:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c8d73ee600/0x63a04852f462865b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f4628654 expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309435.122873:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8d73ee600, rc 0) 00000100:00100000:0.0:1788309435.122908:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+15:5834:x1875178210488448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309435.122914:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788309435.123129:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e6978000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210488448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788309435.123144:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff97c8c153ba00/0x63a04852f4628654 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f462865b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309435.123153:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff97c8c153ba00/0x63a04852f4628654 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x63a04852f462865b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309435.123206:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecf15f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210488576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788309435.123236:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309435.123253:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8ffbdd780 going to sleep for 11 seconds 00000100:00100000:0.0:1788309435.123554:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210488576 00000100:00100000:0.0:1788309435.123560:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210488576 00000100:00100000:0.0:1788309435.123580:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788309435.123587:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+15:5834:x1875178210488576:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788309435.124670:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+15:5834:x1875178210488576:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1078us (1428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309435.124691:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788309435.125578:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecf15f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210488576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788309435.125700:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecf15f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210488704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788309435.125769:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309435.126073:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8ffbdd780 going to sleep for 11 seconds 00000100:00100000:3.0:1788309435.126116:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210488704 00000100:00100000:3.0:1788309435.126188:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210488704 00000100:00100000:3.0:1788309435.126306:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788309435.126316:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+15:5834:x1875178210488704:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788309435.126536:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+15:5834:x1875178210488704:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 221us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309435.126544:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788309435.126632:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecf15f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210488704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788309435.127335:0:8463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecf15f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:8463:1875178210488832:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788309435.127384:0:8463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309435.128263:0:8463:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8ffbdd3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788309435.128441:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210488832 00000100:00100000:0.0:1788309435.128449:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210488832 00000100:00100000:0.0:1788309435.128504:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788309435.128514:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+15:8463:x1875178210488832:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788309435.129389:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+15:8463:x1875178210488832:12345-0@lo:502:llog_process_th.0 Request processed in 871us (1998us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309435.129400:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788309435.131357:0:8463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecf15f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:8463:1875178210488832:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788309435.131446:0:8463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecf15f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:8463:1875178210488960:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788309435.131541:0:8463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309435.131579:0:8463:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8ffbdd3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788309435.131663:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210488960 00000100:00100000:3.0:1788309435.131673:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210488960 00000100:00100000:3.0:1788309435.131738:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788309435.131750:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+15:8463:x1875178210488960:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788309435.132434:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+15:8463:x1875178210488960:12345-0@lo:502:llog_process_th.0 Request processed in 683us (890us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309435.132443:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788309435.132675:0:8463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecf15f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:8463:1875178210488960:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788309435.132704:0:8463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788309435.133311:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1788309435.133337:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788309435.133349:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8c153ba00/0x63a04852f4628654 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f462865b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309435.133363:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff97c8c153ba00/0x63a04852f4628654 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f462865b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788309435.133374:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788309435.133377:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1788309435.133380:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788309435.133417:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8d73efc00/0x63a04852f4628662 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309435.133425:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff97c8d73efc00/0x63a04852f4628662 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309435.133435:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff97c8d73efc00/0x63a04852f4628662 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309435.133457:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8efc4f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210489088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788309435.133538:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309435.133576:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8f4ce5f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788309435.133686:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210489088 00000100:00100000:3.0:1788309435.133694:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210489088 00000100:00100000:3.0:1788309435.133736:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788309435.133745:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+15:5834:x1875178210489088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788309435.133757:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309435.133769:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c8c153a600/0x63a04852f4628669 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x63a04852f4628662 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309435.133793:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8c153a600/0x63a04852f4628669 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63a04852f4628662 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309435.133804:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c8c153a600/0x63a04852f4628669 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f4628662 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309435.134536:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8c153a600, rc 0) 00000100:00100000:3.0:1788309435.134611:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+16:5834:x1875178210489088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 865us (1071us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309435.134617:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788309435.135679:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8efc4f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210489088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788309435.135716:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff97c8d73efc00/0x63a04852f4628662 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4628669 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309435.135733:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff97c8d73efc00/0x63a04852f4628662 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x63a04852f4628669 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309435.136570:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecf15f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210489216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788309435.136643:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309435.136737:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8ffbdd3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788309435.136779:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210489216 00000100:00100000:3.0:1788309435.136786:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210489216 00000100:00100000:3.0:1788309435.137080:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788309435.137091:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+16:5834:x1875178210489216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788309435.147221:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+16:5834:x1875178210489216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 10119us (10564us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309435.147238:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788309435.147566:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecf15f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210489216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788309435.147633:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecf15f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210489344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788309435.147694:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309435.147793:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8ffbdd3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788309435.148245:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210489344 00000100:00100000:1.0:1788309435.148254:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210489344 00000100:00100000:1.0:1788309435.148389:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788309435.148402:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+16:5834:x1875178210489344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788309435.148940:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+16:5834:x1875178210489344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 528us (1234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309435.149064:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788309435.149265:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecf15f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210489344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788309435.161776:0:8464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecdc0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:8464:1875178210489472:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788309435.161881:0:8464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309435.161937:0:8464:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8ea245540 going to sleep for 11 seconds 00000100:00100000:0.0:1788309435.162112:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210489472 00000100:00100000:0.0:1788309435.162131:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210489472 00000100:00100000:0.0:1788309435.162188:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788309435.162199:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+16:8464:x1875178210489472:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788309435.163669:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+16:8464:x1875178210489472:12345-0@lo:502:llog_process_th.0 Request processed in 1464us (1780us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309435.163681:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788309435.163798:0:8464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecdc0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:8464:1875178210489472:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788309435.163848:0:8464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788309435.163857:0:8464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788309435.163859:0:8464:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788309435.163866:0:8464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788309435.163897:0:8464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecf15180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:8464:1875178210489600:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788309435.163959:0:8464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309435.163995:0:8464:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8ffbdd780 going to sleep for 11 seconds 00000100:00100000:0.0:1788309435.164142:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210489600 00000100:00100000:0.0:1788309435.164148:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210489600 00000100:00100000:0.0:1788309435.164188:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788309435.164197:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+16:8464:x1875178210489600:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788309435.164404:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+16:8464:x1875178210489600:12345-0@lo:502:llog_process_th.0 Request processed in 207us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309435.164422:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788309435.164737:0:8464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecf15180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:8464:1875178210489600:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788309435.164760:0:8464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788309435.164765:0:8464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788309435.164767:0:8464:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788309435.164777:0:8464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:0.0:1788309435.165666:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1788309435.165689:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788309435.165699:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8d73efc00/0x63a04852f4628662 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4628669 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309435.165711:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff97c8d73efc00/0x63a04852f4628662 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4628669 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788309435.165722:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788309435.165724:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97c8e07b1000 from 39 10000000:01000000:0.0:1788309435.165728:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788309435.165757:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8d73ee200/0x63a04852f4628670 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309435.165773:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff97c8d73ee200/0x63a04852f4628670 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309435.165783:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff97c8d73ee200/0x63a04852f4628670 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309435.165804:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8efc4ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210489728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788309435.165858:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309435.165897:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8f4ce5f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788309435.166063:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210489728 00000100:00100000:1.0:1788309435.166070:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210489728 00000100:00100000:1.0:1788309435.166125:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788309435.166135:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+16:5834:x1875178210489728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788309435.166146:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788309435.166160:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c8f5549400/0x63a04852f4628677 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x63a04852f4628670 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309435.166183:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8f5549400/0x63a04852f4628677 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63a04852f4628670 expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309435.166193:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c8f5549400/0x63a04852f4628677 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f4628670 expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309435.166203:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8f5549400, rc 0) 00000100:00100000:1.0:1788309435.166602:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+17:5834:x1875178210489728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 467us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309435.166608:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788309435.167233:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8efc4ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210489728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788309435.167251:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff97c8d73ee200/0x63a04852f4628670 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4628677 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309435.167262:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff97c8d73ee200/0x63a04852f4628670 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x63a04852f4628677 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309435.170054:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8efc4ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210489856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788309435.170250:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309435.170323:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8f4ce5f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788309435.170490:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210489856 00000100:00100000:1.0:1788309435.170498:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210489856 00000100:00100000:1.0:1788309435.170557:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788309435.170567:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+17:5834:x1875178210489856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788309435.171512:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+17:5834:x1875178210489856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 943us (1260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309435.171522:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788309435.171744:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8efc4ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210489856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788309435.171786:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8efc4ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210489984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788309435.172238:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309435.172324:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8f4ce5f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788309435.172389:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210489984 00000100:00100000:2.0:1788309435.172396:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210489984 00000100:00100000:2.0:1788309435.172587:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788309435.172598:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+17:5834:x1875178210489984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788309435.172790:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+17:5834:x1875178210489984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 194us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309435.172797:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788309435.172891:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8efc4ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210489984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788309435.174920:0:8465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecdc1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:8465:1875178210490112:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788309435.175025:0:8465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309435.176826:0:8465:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8ea245480 going to sleep for 11 seconds 00000100:00100000:0.0:1788309435.177235:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210490112 00000100:00100000:0.0:1788309435.177247:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210490112 00000100:00100000:0.0:1788309435.177335:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788309435.177348:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+17:8465:x1875178210490112:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788309435.182625:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+17:8465:x1875178210490112:12345-0@lo:502:llog_process_th.0 Request processed in 5263us (7582us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309435.182645:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788309435.183404:0:8465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecdc1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:8465:1875178210490112:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788309435.183511:0:8465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecf15180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:8465:1875178210490240:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788309435.183579:0:8465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309435.183618:0:8465:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8ffbddb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788309435.183853:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210490240 00000100:00100000:0.0:1788309435.183862:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210490240 00000100:00100000:0.0:1788309435.183912:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788309435.183923:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+17:8465:x1875178210490240:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788309435.184423:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+17:8465:x1875178210490240:12345-0@lo:502:llog_process_th.0 Request processed in 501us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309435.184430:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788309435.185483:0:8465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecf15180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:8465:1875178210490240:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788309435.185526:0:8465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788309435.185838:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1788309435.185861:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788309435.185873:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8d73ee200/0x63a04852f4628670 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4628677 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309435.185886:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff97c8d73ee200/0x63a04852f4628670 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4628677 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788309435.185898:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788309435.185901:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1788309435.185904:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788309435.185942:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8f5549a00/0x63a04852f462867e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309435.185951:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff97c8f5549a00/0x63a04852f462867e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309435.185960:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff97c8f5549a00/0x63a04852f462867e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309435.185983:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecdc1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210490368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788309435.186032:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309435.186085:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8ea2453c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788309435.186105:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210490368 00000100:00100000:1.0:1788309435.186111:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210490368 00000100:00100000:1.0:1788309435.186152:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788309435.186171:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+17:5834:x1875178210490368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788309435.186331:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788309435.186346:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c8f5549c00/0x63a04852f4628685 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x63a04852f462867e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309435.186368:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8f5549c00/0x63a04852f4628685 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63a04852f462867e expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309435.186378:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c8f5549c00/0x63a04852f4628685 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f462867e expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309435.186388:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8f5549c00, rc 0) 00000100:00100000:1.0:1788309435.186433:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+18:5834:x1875178210490368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 273us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309435.186440:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788309435.186577:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecdc1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210490368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788309435.186590:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff97c8f5549a00/0x63a04852f462867e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4628685 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309435.186599:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff97c8f5549a00/0x63a04852f462867e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x63a04852f4628685 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309435.186651:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e697a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210490496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788309435.186678:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309435.192736:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8fc91aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788309435.194675:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210490496 00000100:00100000:1.0:1788309435.194692:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210490496 00000100:00100000:1.0:1788309435.194750:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788309435.194762:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+18:5834:x1875178210490496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788309435.195112:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+18:5834:x1875178210490496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 351us (8431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309435.195121:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788309435.195320:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e697a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210490496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788309435.195375:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e697a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210490624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788309435.195446:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309435.195518:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8fc91aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788309435.195535:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210490624 00000100:00100000:1.0:1788309435.195539:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210490624 00000100:00100000:1.0:1788309435.195561:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788309435.195575:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+18:5834:x1875178210490624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788309435.195735:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+18:5834:x1875178210490624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 161us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309435.195743:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788309435.196672:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e697a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210490624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788309435.205629:0:8466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecdc0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:8466:1875178210490752:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788309435.205736:0:8466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309435.205790:0:8466:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8ea245000 going to sleep for 11 seconds 00000100:00100000:3.0:1788309435.207587:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210490752 00000100:00100000:3.0:1788309435.207603:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210490752 00000100:00100000:3.0:1788309435.207695:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788309435.207707:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+18:8466:x1875178210490752:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788309435.208087:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+18:8466:x1875178210490752:12345-0@lo:502:llog_process_th.0 Request processed in 381us (2351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309435.208096:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788309435.208238:0:8466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecdc0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:8466:1875178210490752:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788309435.208308:0:8466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788309435.208319:0:8466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788309435.208321:0:8466:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788309435.208328:0:8466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788309435.208361:0:8466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecdc0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:8466:1875178210490880:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788309435.208402:0:8466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309435.208442:0:8466:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8ea245000 going to sleep for 11 seconds 00000100:00100000:3.0:1788309435.208732:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210490880 00000100:00100000:3.0:1788309435.208738:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210490880 00000100:00100000:3.0:1788309435.208774:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788309435.208781:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6a6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+18:8466:x1875178210490880:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788309435.208952:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6a6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+18:8466:x1875178210490880:12345-0@lo:502:llog_process_th.0 Request processed in 171us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309435.208959:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788309435.209507:0:8466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecdc0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:8466:1875178210490880:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788309435.209537:0:8466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788309435.209543:0:8466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788309435.209545:0:8466:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788309435.209549:0:8466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1788309435.209846:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1788309435.209874:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788309435.209886:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8f5549a00/0x63a04852f462867e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4628685 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309435.209898:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff97c8f5549a00/0x63a04852f462867e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4628685 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788309435.209907:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788309435.209911:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff97c8e661b370 from 1 10000000:01000000:0.0:1788309435.209914:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788309435.210085:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8d73ee800/0x63a04852f462868c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309435.210094:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff97c8d73ee800/0x63a04852f462868c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309435.210103:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff97c8d73ee800/0x63a04852f462868c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309435.210149:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8efc4d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210491008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788309435.210195:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309435.210231:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d6aecc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788309435.210663:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210491008 00000100:00100000:3.0:1788309435.210670:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210491008 00000100:00100000:3.0:1788309435.210719:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788309435.210728:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6a6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+18:5834:x1875178210491008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788309435.210741:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309435.210758:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c8c153b200/0x63a04852f4628693 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x63a04852f462868c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309435.210787:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8c153b200/0x63a04852f4628693 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63a04852f462868c expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309435.210807:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c8c153b200/0x63a04852f4628693 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f462868c expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309435.210816:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8c153b200, rc 0) 00000100:00100000:3.0:1788309435.210869:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6a6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:5834:x1875178210491008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309435.210875:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788309435.213488:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8efc4d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210491008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788309435.213518:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff97c8d73ee800/0x63a04852f462868c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4628693 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309435.213531:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff97c8d73ee800/0x63a04852f462868c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x63a04852f4628693 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309435.213637:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecdc0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210491136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788309435.213697:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309435.213740:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8ea245000 going to sleep for 11 seconds 00000100:00100000:3.0:1788309435.213823:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210491136 00000100:00100000:3.0:1788309435.213830:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210491136 00000100:00100000:3.0:1788309435.213882:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788309435.213892:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6a6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:5834:x1875178210491136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788309435.214142:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6a6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:5834:x1875178210491136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 250us (444us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788309435.214149:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788309435.214416:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecdc0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210491136:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1788309435.214444:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788309435.214452:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8d73ee800/0x63a04852f462868c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4628693 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309435.214469:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff97c8d73ee800/0x63a04852f462868c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4628693 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309435.332817:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309435.332860:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309435.332891:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309435.332924:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309435.333012:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192639232 00000100:00100000:2.0:1788309435.333022:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192639232 00000100:00100000:2.0:1788309435.333109:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 24 00000100:00100000:2.0:1788309435.333129:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecdc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:2350:x1875178192639232:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:2.0:1788309435.333210:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecdc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:2350:x1875178192639232:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 92us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309435.333217:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 24 00000100:00080000:1.0:1788309435.333381:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788309435.333800:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192639360 00000100:00100000:3.0:1788309435.333806:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192639360 00000100:00100000:3.0:1788309435.333857:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192639488 00000100:00100000:3.0:1788309435.333861:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192639488 00000100:00100000:3.0:1788309435.333876:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 9 00000100:00100000:3.0:1788309435.333883:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecdc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+5:2350:x1875178192639360:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788309435.333925:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecdc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+5:2350:x1875178192639360:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 42us (1064us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309435.333931:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 9 00000100:00100000:3.0:1788309435.333946:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 10 00000100:00100000:3.0:1788309435.333952:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecdc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+5:2350:x1875178192639488:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788309435.333994:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecdc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+5:2350:x1875178192639488:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 42us (1069us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309435.334001:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 10 00000100:00080000:1.0:1788309435.334133:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788309435.334137:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788309435.336189:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192639104 00000100:00100000:0.0:1788309435.336202:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192639104 00000100:00100000:0.0:1788309435.336267:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 170 00000100:00100000:0.0:1788309435.336317:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6a6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8351692-8d1a-4b41-bdaf-bf179786ff59+10:2350:x1875178192639104:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788309435.336389:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6a6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8351692-8d1a-4b41-bdaf-bf179786ff59+10:2350:x1875178192639104:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 114us (3584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309435.336397:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 170 00000100:00100000:1.0:1788309435.876006:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecdc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3300:1875178210491264:0@lo:400:kworker.0 00000100:00100000:1.0:1788309435.876078:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309435.876122:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecdc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875178210491776:0@lo:400:kworker.0 00000100:00100000:1.0:1788309435.876149:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309435.876178:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788309435.876184:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecdc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875178210491392:0@lo:400:kworker.0 00000100:00100000:1.0:1788309435.876205:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309435.876242:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecdc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210491904:0@lo:400:kworker.0 00000100:00100000:1.0:1788309435.876268:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309435.876321:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecdc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875178210491520:0@lo:400:kworker.0 00000100:00100000:1.0:1788309435.876344:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309435.876364:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788309435.876369:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecdc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875178210491648:0@lo:400:kworker.0 00000100:00100000:1.0:1788309435.876391:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309435.876426:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210491776 00000100:00100000:1.0:1788309435.876433:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210491776 00000100:00100000:1.0:1788309435.876496:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210491392 00000100:00100000:1.0:1788309435.876500:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210491392 00000100:00100000:1.0:1788309435.876510:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210491520 00000100:00100000:1.0:1788309435.876512:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210491520 00000100:00100000:1.0:1788309435.876527:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788309435.876535:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecdc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875178210491776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309435.876583:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecdc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875178210491776:12345-0@lo:400:kworker.0 Request processed in 49us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309435.876590:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788309435.876606:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788309435.876612:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecdc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875178210491392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309435.876638:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecdc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875178210491392:12345-0@lo:400:kworker.0 Request processed in 26us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309435.876643:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788309435.876655:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788309435.876662:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecdc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875178210491520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309435.876692:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecdc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875178210491520:12345-0@lo:400:kworker.0 Request processed in 31us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309435.876708:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788309435.876728:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210491904 00000100:00100000:1.0:1788309435.876731:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210491904 00000100:00100000:1.0:1788309435.876755:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210491648 00000100:00100000:1.0:1788309435.876759:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210491648 00000100:00100000:1.0:1788309435.876777:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788309435.876782:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecdc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1875178210491904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309435.876813:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecdc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1875178210491904:12345-0@lo:400:kworker.0 Request processed in 30us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309435.876818:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788309435.876828:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788309435.876833:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecdc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875178210491648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309435.876859:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecdc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875178210491648:12345-0@lo:400:kworker.0 Request processed in 26us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309435.876864:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1788309435.876885:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788309435.876888:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788309435.876891:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788309435.876918:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8ecdc2a00 x1875178210491648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788309451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788309435.876931:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecdc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875178210491648:0@lo:400:kworker.0 00000100:00100000:1.0:1788309435.876940:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecdc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875178210491520:0@lo:400:kworker.0 00000100:00100000:1.0:1788309435.876965:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecdc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875178210491392:0@lo:400:kworker.0 00010000:00080000:1.0:1788309435.876974:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8ecdc1500 x1875178210491904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788309451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788309435.876992:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecdc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210491904:0@lo:400:kworker.0 00000100:00100000:1.0:1788309435.877003:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecdc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875178210491776:0@lo:400:kworker.0 00000100:00100000:3.0:1788309435.877424:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210491264 00000100:00100000:3.0:1788309435.877429:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210491264 00000100:00100000:3.0:1788309435.877472:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788309435.877481:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6a6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:3300:x1875178210491264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309435.877520:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6a6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:3300:x1875178210491264:12345-0@lo:400:kworker.0 Request processed in 41us (1442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309435.877526:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788309435.878536:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecdc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3300:1875178210491264:0@lo:400:kworker.0 00010000:00010000:3.0:1788309436.149245:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788309436.267207:0:8503:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff432043f0 20000000:00000080:2.0:1788309436.267234:0:8503:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff97c8e6900c00 uarg=0000000000000000 20000000:01000000:2.0:1788309436.267337:0:8503:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788309436.267345:0:8503:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788309436.267353:0:8503:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788309436.268581:0:8504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1788309436.268853:0:8503:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1788309436.279095:0:8503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1788309436.279158:0:8503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1788309436.279216:0:8503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1788309436.279235:0:8503:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788309436.279258:0:8503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97c8e26d9a00/0x63a04852f462869a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309436.279309:0:8503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c8d73ef800/0x63a04852f462840f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f4628408 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309436.279317:0:8503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c8c153a200/0x63a04852f4628471 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f462846a expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309436.279324:0:8503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c8d73efe00/0x63a04852f462853c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f4628535 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309436.279333:0:8503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c8f5549e00/0x63a04852f46285f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a8d4 expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309436.279339:0:8503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97c8e26d9a00/0x63a04852f462869a lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309436.279378:0:8503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c8f5549e00/0x63a04852f46285f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a8d4 expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309436.279394:0:8503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97c8f5549e00/0x63a04852f46285f9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a8d4 expref: 9 pid: 5832 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309436.279409:0:8503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecf15180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8503:1875178210492032:192.168.202.55@tcp:104: 00010000:00010000:2.0:1788309436.279542:0:8503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c8d73efe00/0x63a04852f462853c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x63a04852f4628535 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309436.281304:0:8503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97c8d73efe00/0x63a04852f462853c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x63a04852f4628535 expref: 18 pid: 5831 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309436.281333:0:8503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecf14a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8503:1875178210492160:0@lo:104: 00000100:00100000:1.0:1788309436.281959:0:8503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788309436.282028:0:8503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c8c153a200/0x63a04852f4628471 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x63a04852f462846a expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309436.282040:0:8503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97c8c153a200/0x63a04852f4628471 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x63a04852f462846a expref: 18 pid: 5831 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309436.282177:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210492160 00000100:00100000:3.0:1788309436.282184:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210492160 00000100:00100000:3.0:1788309436.282233:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788309436.282243:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecdc2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+3:8503:x1875178210492160:12345-0@lo:104: 00010000:00010000:3.0:1788309436.282255:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff97c8d73eea00/0x63a04852f4628535 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x63a04852f462853c expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309436.282330:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788309436.282337:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecdc2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+3:8503:x1875178210492160:12345-0@lo:104: Request processed in 95us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309436.282343:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:3.0:1788309436.282367:0:7628:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788309436.282372:0:7628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff97c8d73eea00/0x63a04852f4628535 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x63a04852f462853c expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309436.282393:0:7628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8d73eea00 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:3.0:1788309436.282397:0:7628:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff97c8d73eea00/0x63a04852f4628535 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x63a04852f462853c expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309436.282405:0:7628:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff97c8d73eea00/0x63a04852f4628535 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x63a04852f462853c expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788309436.282412:0:7628:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff97c8d73eea00/0x63a04852f4628535 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x63a04852f462853c expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788309436.282417:0:7628:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788309436.282446:0:7628:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff97c8d73eea00/0x63a04852f4628535 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f462853c expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309436.282464:0:7628:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788309436.282492:0:7628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff97c8d73eea00/0x63a04852f4628535 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f462853c expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309436.282499:0:7628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff97c8d73eea00/0x63a04852f4628535 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f462853c expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309436.282510:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309436.282512:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309436.282514:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788309436.282534:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e697a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3302:1875178210492416:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788309436.282565:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309436.282954:0:8503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecdc3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8503:1875178210492288:0@lo:104: 00000100:00100000:1.0:1788309436.282982:0:8503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788309436.283015:0:8503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c8d73ef800/0x63a04852f462840f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x63a04852f4628408 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309436.283025:0:8503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97c8d73ef800/0x63a04852f462840f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x63a04852f4628408 expref: 18 pid: 5831 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309436.283033:0:8503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecdc1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8503:1875178210492544:0@lo:104: 00000100:00100000:2.0:1788309436.283095:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210492416 00000100:00100000:2.0:1788309436.283100:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210492416 00010000:00010000:2.0:1788309436.283121:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c8d73efe00/0x63a04852f462853c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63a04852f4628535 expref: 19 pid: 5831 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309436.283144:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788309436.283152:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6979880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:3302:x1875178210492416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788309436.283162:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788309436.283167:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c8d73efe00/0x63a04852f462853c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63a04852f4628535 expref: 19 pid: 5831 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309436.283177:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c8d73efe00/0x63a04852f462853c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x63a04852f4628535 expref: 19 pid: 5831 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309436.283187:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:2.0:1788309436.283194:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788309436.283197:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210492288 00000100:00100000:3.0:1788309436.283206:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210492288 00000100:00100000:2.0:1788309436.283224:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6979880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:3302:x1875178210492416:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309436.283228:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788309436.283231:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788309436.283234:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c13ac050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+3:8503:x1875178210492288:12345-0@lo:104: 00010000:00010000:3.0:1788309436.283242:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff97c9021e4600/0x63a04852f462846a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x63a04852f4628471 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309436.283265:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e697a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3302:1875178210492416:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788309436.283274:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788309436.283298:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c13ac050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+3:8503:x1875178210492288:12345-0@lo:104: Request processed in 65us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309436.283304:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:3.0:1788309436.283336:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788309436.283342:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff97c9021e4600/0x63a04852f462846a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x63a04852f4628471 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309436.283348:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c9021e4600 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:3.0:1788309436.283352:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff97c9021e4600/0x63a04852f462846a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x63a04852f4628471 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309436.283358:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff97c9021e4600/0x63a04852f462846a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x63a04852f4628471 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788309436.283364:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff97c9021e4600/0x63a04852f462846a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x63a04852f4628471 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788309436.283369:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788309436.283393:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff97c9021e4600/0x63a04852f462846a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f4628471 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309436.283399:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788309436.283411:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff97c9021e4600/0x63a04852f462846a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f4628471 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309436.283422:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff97c9021e4600/0x63a04852f462846a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f4628471 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309436.283432:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309436.283433:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309436.283435:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788309436.283444:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e6978a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3303:1875178210492672:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788309436.283482:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309436.283557:0:8503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309436.283579:0:8503:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d3a5e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788309436.283596:0:8503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecf15180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8503:1875178210492032:192.168.202.55@tcp:104: 00010000:00010000:1.0:1788309436.283606:0:8503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c8d73efe00/0x63a04852f462853c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x63a04852f4628535 expref: 18 pid: 5831 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309436.283617:0:8503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecf14a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8503:1875178210492160:0@lo:104: 00000100:00100000:1.0:1788309436.283635:0:8503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecdc3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8503:1875178210492288:0@lo:104: 00000100:00100000:2.0:1788309436.284762:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210492672 00000100:00100000:2.0:1788309436.284771:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210492672 00010000:00010000:2.0:1788309436.284799:0:8447:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c8c153a200/0x63a04852f4628471 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63a04852f462846a expref: 18 pid: 5831 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309436.285383:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788309436.285393:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6979180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00707c3b-bc67-4313-a42d-1f5d185ea5d5+18:3303:x1875178210492672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788309436.285407:0:8447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788309436.285412:0:8447:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c8c153a200/0x63a04852f4628471 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63a04852f462846a expref: 18 pid: 5831 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309436.285422:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210492544 00010000:00010000:2.0:1788309436.285422:0:8447:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c8c153a200/0x63a04852f4628471 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x63a04852f462846a expref: 18 pid: 5831 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309436.285427:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210492544 00010000:00010000:2.0:1788309436.285438:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c8c153a200/0x63a04852f4628471 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x63a04852f462846a expref: 18 pid: 5831 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309436.285465:0:8447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788309436.285470:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788309436.285477:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecdc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+3:8503:x1875178210492544:12345-0@lo:104: 00010000:00010000:3.0:1788309436.285486:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff97c9021e5600/0x63a04852f4628408 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x63a04852f462840f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309436.285524:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6979180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00707c3b-bc67-4313-a42d-1f5d185ea5d5+17:3303:x1875178210492672:12345-0@lo:103:ldlm_bl.0 Request processed in 134us (2042us total) trans 0 rc 0/0 00010000:00010000:3.0:1788309436.285530:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788309436.285532:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788309436.285534:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecdc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+3:8503:x1875178210492544:12345-0@lo:104: Request processed in 60us (1978us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309436.285539:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1788309436.285551:0:7627:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788309436.285556:0:7627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff97c9021e5600/0x63a04852f4628408 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x63a04852f462840f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309436.285562:0:7627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c9021e5600 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:3.0:1788309436.285566:0:7627:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff97c9021e5600/0x63a04852f4628408 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x63a04852f462840f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309436.285573:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e6978a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3303:1875178210492672:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788309436.285585:0:7627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff97c9021e5600/0x63a04852f4628408 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x63a04852f462840f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788309436.285591:0:7627:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff97c9021e5600/0x63a04852f4628408 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x63a04852f462840f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788309436.285597:0:7627:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788309436.285625:0:7627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff97c9021e5600/0x63a04852f4628408 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f462840f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309436.285632:0:7627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788309436.285652:0:7627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff97c9021e5600/0x63a04852f4628408 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f462840f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309436.285658:0:7627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff97c9021e5600/0x63a04852f4628408 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f462840f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309436.285671:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309436.285673:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309436.285674:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788309436.285686:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e6979f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3300:1875178210492800:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788309436.285718:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309436.286173:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210492800 00000100:00100000:2.0:1788309436.286179:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210492800 00010000:00010000:2.0:1788309436.286199:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c8d73ef800/0x63a04852f462840f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63a04852f4628408 expref: 17 pid: 5831 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309436.286231:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788309436.286237:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6978e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+17:3300:x1875178210492800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788309436.286246:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788309436.286250:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c8d73ef800/0x63a04852f462840f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63a04852f4628408 expref: 17 pid: 5831 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309436.286271:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c8d73ef800/0x63a04852f462840f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x63a04852f4628408 expref: 17 pid: 5831 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309436.286306:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788309436.286341:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6978e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+17:3300:x1875178210492800:12345-0@lo:103:ldlm_bl.0 Request processed in 104us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309436.286347:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788309436.286372:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e6979f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3300:1875178210492800:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788309436.287089:0:8503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c8d73ef800/0x63a04852f462840f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x63a04852f4628408 expref: 16 pid: 5831 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309436.287108:0:8503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecdc1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8503:1875178210492544:0@lo:104: 00010000:00010000:1.0:1788309436.287145:0:8503:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97c8e26d9a00/0x63a04852f462869a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309436.295437:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309436.295523:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192639616 00000100:00100000:2.0:1788309436.295533:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192639616 00010000:00010000:2.0:1788309436.295586:0:8447:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c8f5549e00/0x63a04852f46285f9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a8d4 expref: 10 pid: 5832 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309436.295646:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 24 00000100:00100000:2.0:1788309436.295657:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e697b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f8351692-8d1a-4b41-bdaf-bf179786ff59+10:2351:x1875178192639616:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788309436.295672:0:8447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788309436.295677:0:8447:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c8f5549e00/0x63a04852f46285f9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a8d4 expref: 10 pid: 5832 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309436.295690:0:8447:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c8f5549e00/0x63a04852f46285f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a8d4 expref: 10 pid: 5832 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309436.295707:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c8f5549e00/0x63a04852f46285f9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a8d4 expref: 10 pid: 5832 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309436.295724:0:8447:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97c8e26d9a00/0x63a04852f462869a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309436.295747:0:8447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8e26d9a00/0x63a04852f462869a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309436.295762:0:8447:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97c8e26d9a00/0x63a04852f462869a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309436.295770:0:8447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97c8e26d9a00/0x63a04852f462869a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309436.295776:0:8447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97c8e26d9a00/0x63a04852f462869a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309436.295782:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97c8e26d9a00/0x63a04852f462869a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309436.295788:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d9a00 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:2.0:1788309436.295793:0:8447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97c8e26d9a00/0x63a04852f462869a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309436.295800:0:8447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97c8e26d9a00/0x63a04852f462869a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309436.295816:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97c8e26d9a00/0x63a04852f462869a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309436.295826:0:8447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788309436.295887:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e697b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f8351692-8d1a-4b41-bdaf-bf179786ff59+9:2351:x1875178192639616:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 231us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309436.295894:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 24 00010000:00010000:1.0:1788309436.295927:0:8503:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97c8e26d9a00/0x63a04852f462869a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309436.295935:0:8503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97c8e26d9a00/0x63a04852f462869a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309436.295942:0:8503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c8e26d9a00/0x63a04852f462869a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309436.388108:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788309436.388131:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecf15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210492928:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788309436.388193:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309436.388311:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210492928 00000100:00100000:2.0:1788309436.388331:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210492928 00000100:00100000:2.0:1788309436.388383:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788309436.388392:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecdc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875178210492928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788309436.388424:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788309436.388485:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecdc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875178210492928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309436.388492:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1788309436.388528:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8ecf15880 x1875178210492928/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788309452 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788309436.388545:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecf15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210492928:0@lo:13:osp-pre-1-0.0 10000000:01000000:2.0:1788309436.715466:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788309436.715474:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97c8f519c800 from 4 10000000:01000000:2.0:1788309436.715480:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788309436.715529:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8600/0x63a04852f46286a1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309436.715541:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8600/0x63a04852f46286a1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309436.715553:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8600/0x63a04852f46286a1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309436.715581:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecf15880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210493056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788309436.715652:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309436.715720:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d3a5e780 going to sleep for 11 seconds 00000100:00100000:1.0:1788309436.716600:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210493056 00000100:00100000:1.0:1788309436.716611:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210493056 00000100:00100000:1.0:1788309436.716677:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788309436.716687:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6a6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+16:5834:x1875178210493056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788309436.716701:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788309436.716719:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c8f5548a00/0x63a04852f46286a8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x63a04852f46286a1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309436.716743:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8f5548a00/0x63a04852f46286a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63a04852f46286a1 expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309436.716769:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c8f5548a00/0x63a04852f46286a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f46286a1 expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309436.716779:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8f5548a00, rc 0) 00000100:00100000:1.0:1788309436.716988:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6a6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+17:5834:x1875178210493056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 302us (1335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309436.716994:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788309436.718345:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecf15880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210493056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788309436.718370:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8600/0x63a04852f46286a1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f46286a8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309436.718399:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8600/0x63a04852f46286a1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x63a04852f46286a8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309436.718499:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecf15880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210493184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788309436.718546:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309436.718589:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d3a5e780 going to sleep for 11 seconds 00000100:00100000:0.0:1788309436.718911:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210493184 00000100:00100000:0.0:1788309436.718919:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210493184 00000100:00100000:0.0:1788309436.718971:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788309436.718981:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6a6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+17:5834:x1875178210493184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788309436.719257:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6a6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+17:5834:x1875178210493184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 277us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309436.719265:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788309436.719323:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecf15880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210493184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788309436.719352:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecf15880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210493312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788309436.719391:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309436.719411:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d3a5e780 going to sleep for 11 seconds 00000100:00100000:1.0:1788309436.719419:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210493312 00000100:00100000:1.0:1788309436.719424:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210493312 00000100:00100000:1.0:1788309436.719466:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788309436.719474:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6a6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+17:5834:x1875178210493312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788309436.719616:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6a6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+17:5834:x1875178210493312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 143us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309436.719622:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788309436.719842:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecf15880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210493312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788309436.720579:0:8516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8efc4f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:8516:1875178210493440:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788309436.720625:0:8516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309436.720710:0:8516:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c55f36c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788309436.724591:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210493440 00000100:00100000:3.0:1788309436.724604:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210493440 00000100:00100000:3.0:1788309436.724660:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788309436.724670:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6a6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+17:8516:x1875178210493440:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788309436.725001:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6a6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+17:8516:x1875178210493440:12345-0@lo:502:llog_process_th.0 Request processed in 331us (4373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309436.725014:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788309436.725354:0:8516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8efc4f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:8516:1875178210493440:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788309436.725388:0:8516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788309436.725397:0:8516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788309436.725399:0:8516:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788309436.725406:0:8516:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97c8f519c800 00000020:00000080:1.0:1788309436.725408:0:8516:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788309436.725540:0:8516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecdc3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:8516:1875178210493568:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788309436.725587:0:8516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309436.725623:0:8516:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8ea245900 going to sleep for 11 seconds 00000100:00100000:3.0:1788309436.725977:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210493568 00000100:00100000:3.0:1788309436.725983:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210493568 00000100:00100000:3.0:1788309436.726060:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788309436.726069:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6a6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+17:8516:x1875178210493568:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788309436.726229:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6a6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+17:8516:x1875178210493568:12345-0@lo:502:llog_process_th.0 Request processed in 161us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309436.726235:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788309436.728057:0:8516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecdc3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:8516:1875178210493568:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788309436.728095:0:8516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788309436.728106:0:8516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788309436.728108:0:8516:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788309436.728113:0:8516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788309436.728488:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788309436.728511:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788309436.728522:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8600/0x63a04852f46286a1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f46286a8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309436.728535:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8600/0x63a04852f46286a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f46286a8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788309436.728546:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788309436.728548:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97c8d6805000 from 4 10000000:01000000:2.0:1788309436.728551:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788309436.728583:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8c00/0x63a04852f46286af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309436.728591:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8c00/0x63a04852f46286af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309436.728606:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8c00/0x63a04852f46286af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309436.728625:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecf15880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210493696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788309436.728678:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309436.732157:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d3a5e780 going to sleep for 11 seconds 00000100:00100000:0.0:1788309436.739497:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210493696 00000100:00100000:0.0:1788309436.739515:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210493696 00000100:00100000:0.0:1788309436.739610:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788309436.739622:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6a6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+17:5834:x1875178210493696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788309436.739738:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788309436.739759:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c8d73ef000/0x63a04852f46286b6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x63a04852f46286af expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309436.739791:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8d73ef000/0x63a04852f46286b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63a04852f46286af expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309436.739871:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c8d73ef000/0x63a04852f46286b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f46286af expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309436.739882:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8d73ef000, rc 0) 00000100:00100000:0.0:1788309436.739980:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6a6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+18:5834:x1875178210493696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 359us (11300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309436.739987:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788309436.740104:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecf15880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210493696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788309436.740124:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8c00/0x63a04852f46286af lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f46286b6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309436.740134:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8c00/0x63a04852f46286af lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x63a04852f46286b6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309436.740199:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e697ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210493824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788309436.740231:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309436.740268:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8e6bc1600 going to sleep for 11 seconds 00000100:00100000:0.0:1788309436.740912:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210493824 00000100:00100000:0.0:1788309436.740919:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210493824 00000100:00100000:0.0:1788309436.740957:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788309436.740966:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6a6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+18:5834:x1875178210493824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788309436.741215:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6a6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+18:5834:x1875178210493824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 249us (982us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309436.741222:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788309436.741305:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e697ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210493824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788309436.741341:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e697ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210493952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788309436.741378:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309436.741404:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8e6bc1600 going to sleep for 11 seconds 00000100:00100000:3.0:1788309436.741419:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210493952 00000100:00100000:3.0:1788309436.741422:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210493952 00000100:00100000:3.0:1788309436.741444:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788309436.741470:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6a6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+18:5834:x1875178210493952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788309436.741619:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6a6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+18:5834:x1875178210493952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 150us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309436.741627:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788309436.741655:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e697ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210493952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788309436.748007:0:8519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8efc4f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:8519:1875178210494080:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788309436.748095:0:8519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309436.748128:0:8519:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c2c2d000 going to sleep for 11 seconds 00000100:00100000:3.0:1788309436.748365:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210494080 00000100:00100000:3.0:1788309436.748374:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210494080 00000100:00100000:3.0:1788309436.748417:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788309436.748427:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6a6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+18:8519:x1875178210494080:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788309436.748695:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6a6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+18:8519:x1875178210494080:12345-0@lo:502:llog_process_th.0 Request processed in 267us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309436.748703:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788309436.748841:0:8519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8efc4f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:8519:1875178210494080:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788309436.748872:0:8519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788309436.748883:0:8519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788309436.748885:0:8519:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788309436.748892:0:8519:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97c8d6805000 00000020:00000080:1.0:1788309436.748895:0:8519:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788309436.748982:0:8519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecdc3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:8519:1875178210494208:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788309436.749017:0:8519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309436.749047:0:8519:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8ea245900 going to sleep for 11 seconds 00000100:00100000:0.0:1788309436.749152:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210494208 00000100:00100000:0.0:1788309436.749158:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210494208 00000100:00100000:0.0:1788309436.749192:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788309436.749199:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6a6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+18:8519:x1875178210494208:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788309436.749348:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6a6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+18:8519:x1875178210494208:12345-0@lo:502:llog_process_th.0 Request processed in 149us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309436.749355:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788309436.749581:0:8519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecdc3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:8519:1875178210494208:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788309436.749601:0:8519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788309436.749606:0:8519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788309436.749608:0:8519:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788309436.749611:0:8519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788309436.749781:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788309436.749804:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788309436.749814:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8c00/0x63a04852f46286af lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f46286b6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309436.749826:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8c00/0x63a04852f46286af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f46286b6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788309436.749836:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788309436.749839:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97c8e07b1000 from 4 10000000:01000000:3.0:1788309436.749841:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788309436.749867:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8c153ac00/0x63a04852f46286bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309436.749875:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff97c8c153ac00/0x63a04852f46286bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309436.749896:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff97c8c153ac00/0x63a04852f46286bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309436.749909:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e697ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210494336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788309436.750070:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309436.750092:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8e6bc1780 going to sleep for 11 seconds 00000100:00100000:0.0:1788309436.750926:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210494336 00000100:00100000:0.0:1788309436.750934:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210494336 00000100:00100000:0.0:1788309436.751023:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788309436.751035:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6a6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+18:5834:x1875178210494336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788309436.751047:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788309436.751062:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c8d73ee400/0x63a04852f46286c4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x63a04852f46286bd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309436.751088:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8d73ee400/0x63a04852f46286c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63a04852f46286bd expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309436.751098:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c8d73ee400/0x63a04852f46286c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f46286bd expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309436.751107:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8d73ee400, rc 0) 00000100:00100000:0.0:1788309436.751163:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6a6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:5834:x1875178210494336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (1093us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309436.751169:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788309436.752118:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e697ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210494336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788309436.752142:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff97c8c153ac00/0x63a04852f46286bd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f46286c4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309436.752153:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff97c8c153ac00/0x63a04852f46286bd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x63a04852f46286c4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309436.752222:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e697ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210494464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788309436.752261:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309436.760557:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8e6bc1780 going to sleep for 11 seconds 00000100:00100000:1.0:1788309436.760695:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210494464 00000100:00100000:1.0:1788309436.760705:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210494464 00000100:00100000:1.0:1788309436.760779:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788309436.760790:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6b2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:5834:x1875178210494464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788309436.761144:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6b2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:5834:x1875178210494464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 355us (8880us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309436.761152:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788309436.761249:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e697ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210494464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788309436.761326:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e697ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210494592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788309436.761367:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309436.761388:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8e6bc1780 going to sleep for 11 seconds 00000100:00100000:1.0:1788309436.761515:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210494592 00000100:00100000:1.0:1788309436.761520:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210494592 00000100:00100000:1.0:1788309436.761604:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788309436.761611:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6b2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:5834:x1875178210494592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788309436.761751:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6b2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:5834:x1875178210494592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 141us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309436.761757:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788309436.761866:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e697ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210494592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788309436.762189:0:8520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecdc3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:8520:1875178210494720:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788309436.762227:0:8520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309436.762254:0:8520:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8e0686540 going to sleep for 11 seconds 00000100:00100000:3.0:1788309436.762315:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210494720 00000100:00100000:3.0:1788309436.762319:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210494720 00000100:00100000:3.0:1788309436.762345:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788309436.762351:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6b2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:8520:x1875178210494720:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788309436.762484:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6b2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:8520:x1875178210494720:12345-0@lo:502:llog_process_th.0 Request processed in 132us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309436.762490:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788309436.762614:0:8520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecdc3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:8520:1875178210494720:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788309436.762638:0:8520:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788309436.762647:0:8520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788309436.762650:0:8520:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788309436.762656:0:8520:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97c8e07b1000 00000020:00000080:1.0:1788309436.762659:0:8520:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788309436.762723:0:8520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecdc3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:8520:1875178210494848:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788309436.762755:0:8520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309436.762773:0:8520:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c2c2d000 going to sleep for 11 seconds 00000100:00100000:3.0:1788309436.766059:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210494848 00000100:00100000:3.0:1788309436.766079:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210494848 00000100:00100000:3.0:1788309436.766136:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788309436.766148:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6b2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:8520:x1875178210494848:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788309436.766435:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6b2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:8520:x1875178210494848:12345-0@lo:502:llog_process_th.0 Request processed in 288us (3678us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309436.766443:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788309436.767079:0:8520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecdc3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:8520:1875178210494848:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788309436.767115:0:8520:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788309436.767123:0:8520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788309436.767125:0:8520:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788309436.767130:0:8520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788309436.768019:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788309436.768044:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788309436.768056:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8c153ac00/0x63a04852f46286bd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f46286c4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309436.768068:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff97c8c153ac00/0x63a04852f46286bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f46286c4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309436.896613:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecdc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875178210494976:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788309436.896691:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309436.897267:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210494976 00000100:00100000:1.0:1788309436.897295:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210494976 00000100:00100000:1.0:1788309436.897352:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788309436.897363:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecf15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875178210494976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788309436.897402:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788309436.897472:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecf15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875178210494976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309436.897492:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1788309436.897659:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8ecdc3800 x1875178210494976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788309452 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788309436.897683:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecdc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875178210494976:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788309437.156434:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788309438.155254:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309438.157463:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192639744 00000100:00100000:3.0:1788309438.157477:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192639744 00000100:00100000:3.0:1788309438.157539:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 187 00000100:00100000:3.0:1788309438.157563:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6b2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8351692-8d1a-4b41-bdaf-bf179786ff59+9:5592:x1875178192639744:12345-192.168.202.55@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788309438.157582:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309438.157600:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c8c153bc00/0x63a04852f46286cb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8a28c761146a913 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309438.157633:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8c153bc00/0x63a04852f46286cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a913 expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309438.157655:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c8c153bc00/0x63a04852f46286cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a913 expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309438.157666:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8c153bc00, rc 0) 00000100:00100000:3.0:1788309438.157732:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6b2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8351692-8d1a-4b41-bdaf-bf179786ff59+10:5592:x1875178192639744:12345-192.168.202.55@tcp:101:ll_cfg_requeue.0 Request processed in 174us (2486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309438.157739:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 187 00000100:00100000:1.0:1788309438.177952:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309438.178331:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192639872 00000100:00100000:1.0:1788309438.178341:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192639872 00000100:00100000:1.0:1788309438.178391:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 188 00000100:00100000:1.0:1788309438.178402:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6b2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8351692-8d1a-4b41-bdaf-bf179786ff59+10:5592:x1875178192639872:12345-192.168.202.55@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788309438.178732:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6b2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8351692-8d1a-4b41-bdaf-bf179786ff59+10:5592:x1875178192639872:12345-192.168.202.55@tcp:501:ll_cfg_requeue.0 Request processed in 331us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309438.178741:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 188 00010000:00010000:3.0:1788309438.179856:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788309438.180601:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309438.180654:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192640000 00000100:00100000:3.0:1788309438.180662:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192640000 00000100:00100000:3.0:1788309438.180708:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 189 00000100:00100000:3.0:1788309438.180718:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6b2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8351692-8d1a-4b41-bdaf-bf179786ff59+10:5592:x1875178192640000:12345-192.168.202.55@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788309438.180901:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6b2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8351692-8d1a-4b41-bdaf-bf179786ff59+10:5592:x1875178192640000:12345-192.168.202.55@tcp:503:ll_cfg_requeue.0 Request processed in 184us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309438.180908:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 189 00000100:00100000:3.0:1788309438.188189:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309438.188225:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192640128 00000100:00100000:3.0:1788309438.188235:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192640128 00000100:00100000:3.0:1788309438.188300:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 190 00000100:00100000:3.0:1788309438.188312:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6b2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8351692-8d1a-4b41-bdaf-bf179786ff59+10:6121:x1875178192640128:12345-192.168.202.55@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788309438.188690:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6b2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8351692-8d1a-4b41-bdaf-bf179786ff59+10:6121:x1875178192640128:12345-192.168.202.55@tcp:502:llog_process_th.0 Request processed in 379us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309438.188699:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 190 00000100:00100000:3.0:1788309438.192802:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309438.200487:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192640256 00000100:00100000:3.0:1788309438.200519:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192640256 00000100:00100000:3.0:1788309438.200580:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 191 00000100:00100000:3.0:1788309438.200590:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6b2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8351692-8d1a-4b41-bdaf-bf179786ff59+10:6121:x1875178192640256:12345-192.168.202.55@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788309438.200821:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6b2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8351692-8d1a-4b41-bdaf-bf179786ff59+10:6121:x1875178192640256:12345-192.168.202.55@tcp:502:llog_process_th.0 Request processed in 231us (8040us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309438.200829:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 191 00010000:00010000:3.0:1788309439.200490:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309440.225202:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788309440.454622:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309440.454663:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309440.454690:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309440.454715:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309440.454744:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192640384 00000100:00100000:3.0:1788309440.454754:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192640384 00000100:00100000:3.0:1788309440.454813:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 192 00000100:00100000:3.0:1788309440.454824:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6ae8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8351692-8d1a-4b41-bdaf-bf179786ff59+10:2351:x1875178192640384:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788309440.454890:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6ae8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8351692-8d1a-4b41-bdaf-bf179786ff59+10:2351:x1875178192640384:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 68us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309440.454898:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 192 00000100:00100000:3.0:1788309440.454931:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192640640 00000100:00100000:3.0:1788309440.454935:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192640640 00000100:00100000:3.0:1788309440.454967:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192640768 00000100:00100000:3.0:1788309440.454970:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192640768 00000100:00100000:3.0:1788309440.455302:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 13 00000100:00100000:3.0:1788309440.455311:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e697ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+5:2351:x1875178192640640:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788309440.455342:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e697ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+5:2351:x1875178192640640:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 33us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309440.455360:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 13 00000100:00100000:3.0:1788309440.455372:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 14 00000100:00100000:3.0:1788309440.455378:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e697b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+5:2351:x1875178192640768:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788309440.455402:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e697b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+5:2351:x1875178192640768:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 24us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309440.455409:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 14 00000100:00100000:3.0:1788309440.455436:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192640512 00000100:00100000:3.0:1788309440.455440:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192640512 00000100:00100000:3.0:1788309440.455471:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 28 00000100:00100000:3.0:1788309440.455478:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e697a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:2351:x1875178192640512:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788309440.455505:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e697a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:2351:x1875178192640512:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 28us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309440.455510:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 28 00000100:00080000:3.0:1788309440.455943:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788309440.455948:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788309440.455950:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788309440.993662:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecf17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875178210495232:0@lo:400:kworker.0 00000100:00100000:2.0:1788309440.993747:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309440.993802:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecf14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210495744:0@lo:400:kworker.0 00000100:00100000:2.0:1788309440.993831:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309440.993862:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788309440.993868:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecf14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875178210495360:0@lo:400:kworker.0 00000100:00100000:2.0:1788309440.993890:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309440.993922:0:8305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210495232 00000100:00100000:2.0:1788309440.993931:0:8305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210495232 00000100:00100000:2.0:1788309440.993976:0:8305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210495360 00000100:00100000:2.0:1788309440.993980:0:8305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210495360 00000100:00100000:2.0:1788309440.994013:0:8305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788309440.994023:0:8305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecf15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875178210495232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309440.994077:0:8305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecf15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875178210495232:12345-0@lo:400:kworker.0 Request processed in 55us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309440.994084:0:8305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788309440.994100:0:8305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788309440.994119:0:8305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecf14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875178210495360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309440.994149:0:8305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecf14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875178210495360:12345-0@lo:400:kworker.0 Request processed in 31us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309440.994155:0:8305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788309440.994191:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecf14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875178210495360:0@lo:400:kworker.0 00000100:00100000:2.0:1788309440.994202:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecf17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875178210495232:0@lo:400:kworker.0 00000100:00100000:2.0:1788309440.994427:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210495744 00000100:00100000:2.0:1788309440.994432:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210495744 00000100:00100000:2.0:1788309440.994472:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788309440.994481:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecf15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1875178210495744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309440.994519:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecf15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1875178210495744:12345-0@lo:400:kworker.0 Request processed in 40us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309440.994525:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788309440.994546:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecf16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3303:1875178210495104:0@lo:400:kworker.0 00000100:00100000:2.0:1788309440.994578:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309440.994602:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecf15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875178210495616:0@lo:400:kworker.0 00000100:00100000:2.0:1788309440.994624:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309440.994743:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788309440.994749:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecf15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210495488:0@lo:400:kworker.0 00000100:00100000:2.0:1788309440.994774:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788309440.994843:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8ecf14a80 x1875178210495744/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788309456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788309440.994853:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecf14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210495744:0@lo:400:kworker.0 00000100:00100000:2.0:1788309440.994869:0:8305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210495616 00000100:00100000:2.0:1788309440.994879:0:8305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210495616 00000100:00100000:2.0:1788309440.994904:0:8305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788309440.994909:0:8305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecf17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875178210495616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309440.994942:0:8305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecf17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875178210495616:12345-0@lo:400:kworker.0 Request processed in 33us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309440.994948:0:8305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788309440.994969:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecf15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875178210495616:0@lo:400:kworker.0 00000100:00080000:0.0:1788309440.995223:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788309440.995228:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788309440.995502:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210495104 00000100:00100000:3.0:1788309440.995508:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210495104 00000100:00100000:3.0:1788309440.995540:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1788309440.995547:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6ae8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:3303:x1875178210495104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309440.995600:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6ae8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:3303:x1875178210495104:12345-0@lo:400:kworker.0 Request processed in 54us (1021us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309440.995607:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1788309440.998036:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210495488 00000100:00100000:1.0:1788309440.998049:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210495488 00000100:00100000:0.0:1788309441.001806:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecf16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3303:1875178210495104:0@lo:400:kworker.0 00000100:00080000:1.0:1788309441.004448:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788309441.004701:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788309441.004719:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecf14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210495488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309441.004866:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecf14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210495488:12345-0@lo:400:kworker.0 Request processed in 153us (10090us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309441.004873:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1788309441.011834:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8ecf15500 x1875178210495488/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788309456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788309441.011855:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecf15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210495488:0@lo:400:kworker.0 00010000:00010000:0.0:1788309441.252000:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788309441.511305:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788309441.511331:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecdc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210495872:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788309441.511420:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309441.511530:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210495872 00000100:00100000:1.0:1788309441.511548:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210495872 00000100:00100000:1.0:1788309441.511596:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788309441.511607:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8efc4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875178210495872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788309441.511642:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788309441.511700:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8efc4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875178210495872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309441.511708:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1788309441.512388:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8ecdc0380 x1875178210495872/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788309457 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788309441.512432:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecdc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210495872:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788309442.017508:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788309442.017530:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecdc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210496000:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788309442.017599:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309442.017719:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210496000 00000100:00100000:1.0:1788309442.017727:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210496000 00000100:00100000:1.0:1788309442.017793:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788309442.017803:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecf15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210496000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788309442.017836:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788309442.017884:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecf15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210496000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309442.017892:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1788309442.017931:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8ecdc2a00 x1875178210496000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788309458 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788309442.017951:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecdc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210496000:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788309442.018051:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788309442.273786:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309443.297293:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309444.323112:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788309444.683794:0:8802:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg255-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:0.0:1788309445.345712:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788309445.590573:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309445.590654:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309445.590676:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192641024 00000100:00100000:2.0:1788309445.590687:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309445.590695:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192641024 00000100:00100000:3.0:1788309445.590794:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 32 00000100:00100000:3.0:1788309445.590808:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecf14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:2350:x1875178192641024:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788309445.590929:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecf14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:2350:x1875178192641024:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 118us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309445.590943:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 32 00000100:00100000:2.0:1788309445.590950:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309445.592237:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192641152 00000100:00100000:2.0:1788309445.592250:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192641152 00000100:00100000:2.0:1788309445.592329:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192641280 00000100:00100000:2.0:1788309445.592333:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192641280 00000100:00100000:2.0:1788309445.592353:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 17 00000100:00100000:2.0:1788309445.592375:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecf16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+5:2351:x1875178192641152:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:2.0:1788309445.592512:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecf16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+5:2351:x1875178192641152:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 150us (1826us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309445.592520:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 17 00000100:00100000:2.0:1788309445.592539:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 18 00000100:00100000:2.0:1788309445.592546:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecf16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+5:2350:x1875178192641280:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:2.0:1788309445.592590:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecf16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+5:2350:x1875178192641280:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 45us (1651us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309445.592597:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 18 00000100:00080000:2.0:1788309445.593556:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788309445.593563:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788309445.593566:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788309445.597862:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192640896 00000100:00100000:3.0:1788309445.597879:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192640896 00000100:00100000:3.0:1788309445.597967:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 194 00000100:00100000:3.0:1788309445.597981:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aeb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8351692-8d1a-4b41-bdaf-bf179786ff59+10:2351:x1875178192640896:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788309445.598059:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aeb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8351692-8d1a-4b41-bdaf-bf179786ff59+10:2351:x1875178192640896:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 81us (7404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309445.598067:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 194 00000100:00100000:3.0:1788309446.113501:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8efc4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875178210496256:0@lo:400:kworker.0 00000100:00100000:3.0:1788309446.113580:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309446.113647:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788309446.113654:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8efc4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875178210496384:0@lo:400:kworker.0 00000100:00100000:3.0:1788309446.113679:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309446.113730:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210496256 00000100:00100000:3.0:1788309446.113738:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210496256 00000100:00100000:3.0:1788309446.113807:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210496384 00000100:00100000:3.0:1788309446.113811:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210496384 00000100:00100000:3.0:1788309446.113867:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788309446.113885:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6978380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875178210496256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309446.113958:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6978380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875178210496256:12345-0@lo:400:kworker.0 Request processed in 75us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309446.113967:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788309446.113985:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788309446.113992:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e697aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875178210496384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309446.114020:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e697aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875178210496384:12345-0@lo:400:kworker.0 Request processed in 29us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309446.114026:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1788309446.114045:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788309446.114075:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8efc4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875178210496384:0@lo:400:kworker.0 00000100:00100000:3.0:1788309446.114109:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8efc4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875178210496256:0@lo:400:kworker.0 00000100:00100000:0.0:1788309446.116168:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8efc4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3303:1875178210496128:0@lo:400:kworker.0 00000100:00100000:0.0:1788309446.116238:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309446.116303:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8efc4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875178210496640:0@lo:400:kworker.0 00000100:00100000:0.0:1788309446.116331:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309446.116357:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788309446.116374:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8efc4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210496512:0@lo:400:kworker.0 00000100:00100000:0.0:1788309446.116411:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309446.116454:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788309446.116463:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8efc4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210496768:0@lo:400:kworker.0 00000100:00100000:0.0:1788309446.116488:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309446.116504:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210496128 00000100:00100000:1.0:1788309446.116511:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210496128 00000100:00100000:0.0:1788309446.116535:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210496512 00000100:00100000:0.0:1788309446.116538:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210496512 00000100:00100000:1.0:1788309446.116550:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1788309446.116558:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6ae9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:3303:x1875178210496128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309446.116568:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210496768 00000100:00100000:0.0:1788309446.116571:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210496768 00000100:00100000:0.0:1788309446.116588:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788309446.116608:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c89fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210496512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309446.116609:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6ae9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:3303:x1875178210496128:12345-0@lo:400:kworker.0 Request processed in 51us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309446.116616:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1788309446.116638:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c89fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210496512:12345-0@lo:400:kworker.0 Request processed in 31us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309446.116644:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788309446.116657:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788309446.116675:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c89f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875178210496768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309446.116711:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c89f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875178210496768:12345-0@lo:400:kworker.0 Request processed in 49us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309446.116718:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1788309446.116732:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788309446.116736:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788309446.116752:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8efc4c380 x1875178210496768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788309462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1788309446.116762:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8efc4f480 x1875178210496512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788309462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788309446.116765:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8efc4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210496768:0@lo:400:kworker.0 00000100:00100000:0.0:1788309446.116770:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8efc4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210496512:0@lo:400:kworker.0 00000100:00100000:0.0:1788309446.116776:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8efc4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3303:1875178210496128:0@lo:400:kworker.0 00000100:00100000:1.0:1788309446.116789:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210496640 00000100:00100000:1.0:1788309446.116792:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210496640 00000100:00100000:1.0:1788309446.116830:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788309446.116844:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c89f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875178210496640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309446.116876:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c89f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875178210496640:12345-0@lo:400:kworker.0 Request processed in 34us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309446.116882:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1788309446.117627:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788309446.117654:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8efc4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875178210496640:0@lo:400:kworker.0 00010000:00010000:0.0:1788309446.374410:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788309446.632136:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecf17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210496896:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788309446.632212:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309446.632329:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210496896 00000100:00100000:2.0:1788309446.632337:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210496896 00000100:00100000:2.0:1788309446.632395:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788309446.632406:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecf15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875178210496896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788309446.632440:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788309446.632484:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecf15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875178210496896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309446.632491:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1788309446.632531:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8ecf17100 x1875178210496896/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788309462 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788309446.632551:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecf17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210496896:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788309447.141328:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecdc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875178210497024:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788309447.141418:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309447.141723:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210497024 00000100:00100000:0.0:1788309447.141732:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210497024 00000100:00100000:0.0:1788309447.141779:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788309447.141791:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c89f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875178210497024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788309447.141832:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788309447.141890:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c89f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875178210497024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309447.141897:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1788309447.141940:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8ecdc2a00 x1875178210497024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788309463 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788309447.141963:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecdc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875178210497024:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788309447.402164:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309448.421955:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788309449.182128:0:9045:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg255-server.virtnet: executing yml_node 00010000:00010000:1.0:1788309449.443181:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309450.471707:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788309450.694407:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309450.694458:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309450.697522:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192641408 00000100:00100000:3.0:1788309450.697537:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192641408 00000100:00100000:3.0:1788309450.697597:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 196 00000100:00100000:3.0:1788309450.697610:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8351692-8d1a-4b41-bdaf-bf179786ff59+10:2352:x1875178192641408:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788309450.697698:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8351692-8d1a-4b41-bdaf-bf179786ff59+10:2352:x1875178192641408:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 91us (3301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309450.697706:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 196 00000100:00100000:1.0:1788309450.702332:0:8305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192641536 00000100:00100000:1.0:1788309450.702348:0:8305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192641536 00000100:00080000:2.0:1788309450.702544:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788309450.702576:0:8305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 36 00000100:00100000:1.0:1788309450.702589:0:8305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecf17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:2352:x1875178192641536:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788309450.702690:0:8305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecf17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:2352:x1875178192641536:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 104us (8231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309450.708330:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309450.708752:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309450.708787:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192641664 00000100:00100000:2.0:1788309450.708797:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192641664 00000100:00100000:2.0:1788309450.708863:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192641792 00000100:00100000:2.0:1788309450.708867:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192641792 00000100:00100000:2.0:1788309450.708885:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 10 00000100:00100000:2.0:1788309450.708895:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecf16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+5:2349:x1875178192641664:12345-192.168.202.55@tcp:9:kworker.0 00000020:00000080:2.0:1788309450.708932:0:6681:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x63a04852f4628607 00000100:00080000:2.0:1788309450.708941:0:6681:0:(import.c:65:import_set_state_nolock()) ffff97c8fc787000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788309450.708977:0:6681:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788309450.710178:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecf16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+2:2349:x1875178192641664:12345-192.168.202.55@tcp:9:kworker.0 Request processed in 1275us (1854us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309450.710189:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 10 00000100:00100000:2.0:1788309450.710212:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 11 00000100:00100000:2.0:1788309450.710221:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ec684380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+5:2349:x1875178192641792:12345-192.168.202.55@tcp:9:kworker.0 00000020:00000080:2.0:1788309450.710244:0:6681:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x63a04852f462860e 00000100:00080000:2.0:1788309450.710254:0:6681:0:(import.c:65:import_set_state_nolock()) ffff97c8fc784000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788309450.710299:0:6681:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788309450.710514:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ec684380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+2:2349:x1875178192641792:12345-192.168.202.55@tcp:9:kworker.0 Request processed in 294us (1761us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309450.710521:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 11 00010000:00010000:2.0:1788309450.710594:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788309450.710604:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788309450.710608:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788309450.710800:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788309450.710960:0:8305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 36 00000100:00100000:2.0:1788309451.233585:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ec687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875178210497280:0@lo:400:kworker.0 00000100:00100000:2.0:1788309451.233672:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309451.233726:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8efefb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210497792:0@lo:400:kworker.0 00000100:00100000:2.0:1788309451.233753:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309451.233784:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788309451.233798:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ec686680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875178210497408:0@lo:400:kworker.0 00000100:00100000:2.0:1788309451.233821:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309451.235244:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210497280 00000100:00100000:2.0:1788309451.235258:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210497280 00000100:00100000:2.0:1788309451.235355:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210497408 00000100:00100000:2.0:1788309451.235359:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210497408 00000100:00100000:2.0:1788309451.235393:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788309451.235403:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8efef8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875178210497280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309451.235485:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8efef8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875178210497280:12345-0@lo:400:kworker.0 Request processed in 83us (1813us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309451.235493:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788309451.235508:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788309451.235514:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8efefb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875178210497408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309451.235540:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8efefb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875178210497408:12345-0@lo:400:kworker.0 Request processed in 26us (1718us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309451.235546:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:2.0:1788309451.235560:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788309451.235592:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ec686680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875178210497408:0@lo:400:kworker.0 00000100:00100000:2.0:1788309451.235604:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ec687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875178210497280:0@lo:400:kworker.0 00000100:00100000:1.0:1788309451.243517:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8efefad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875178210497536:0@lo:400:kworker.0 00000100:00100000:1.0:1788309451.243606:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309451.243670:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788309451.243678:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ec687100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3302:1875178210497152:0@lo:400:kworker.0 00000100:00100000:1.0:1788309451.243707:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309451.243737:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8efefa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875178210497664:0@lo:400:kworker.0 00000100:00100000:1.0:1788309451.243760:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309451.243802:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210497792 00000100:00100000:1.0:1788309451.243809:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210497792 00000100:00100000:1.0:1788309451.243858:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210497536 00000100:00100000:1.0:1788309451.243862:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210497536 00000100:00100000:1.0:1788309451.243878:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788309451.243887:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8efefaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1875178210497792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309451.243958:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8efefaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1875178210497792:12345-0@lo:400:kworker.0 Request processed in 72us (10204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309451.243966:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788309451.243981:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788309451.243988:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecdc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875178210497536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309451.244018:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecdc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875178210497536:12345-0@lo:400:kworker.0 Request processed in 31us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309451.244025:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1788309451.244074:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8efefad80 x1875178210497536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788309467 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788309451.244088:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8efefad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875178210497536:0@lo:400:kworker.0 00000100:00080000:2.0:1788309451.244596:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788309451.244603:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788309451.244616:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210497664 00000100:00100000:2.0:1788309451.244622:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210497664 00000100:00100000:2.0:1788309451.244673:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788309451.244680:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecdc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875178210497664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309451.244735:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecdc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875178210497664:12345-0@lo:400:kworker.0 Request processed in 56us (974us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309451.244753:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:2.0:1788309451.244771:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788309451.244798:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8efefb480 x1875178210497792/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788309467 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788309451.244809:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8efefb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210497792:0@lo:400:kworker.0 00000100:00100000:2.0:1788309451.244835:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8efefa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875178210497664:0@lo:400:kworker.0 00000100:00100000:0.0:1788309451.246089:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210497152 00000100:00100000:0.0:1788309451.246102:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210497152 00000100:00100000:0.0:1788309451.246147:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788309451.246157:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:3302:x1875178210497152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309451.246228:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:3302:x1875178210497152:12345-0@lo:400:kworker.0 Request processed in 73us (2519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309451.246248:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1788309451.246634:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ec687100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3302:1875178210497152:0@lo:400:kworker.0 00000001:00100000:3.0:1788309451.298696:0:6706:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 86451057-f8bb-4d7c-a7c2-5c834b43e3d3 00000020:00000080:3.0:1788309451.298707:0:6706:0:(genops.c:885:class_export_put()) final put ffff97c8fc785800/86451057-f8bb-4d7c-a7c2-5c834b43e3d3 00000020:00000080:2.0:1788309451.298814:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff97c8fc785800/86451057-f8bb-4d7c-a7c2-5c834b43e3d3 for lustre-OST0000 00000020:00000080:2.0:1788309451.298874:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97c8fc787000 for lustre-OST0000 00010000:00010000:1.0:1788309451.488528:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788309451.747015:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788309451.750380:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8efefa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210497920:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788309451.750497:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309451.750857:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210497920 00000100:00100000:0.0:1788309451.750867:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210497920 00000100:00100000:0.0:1788309451.750929:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788309451.750940:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e697b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875178210497920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788309451.750979:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788309451.751033:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e697b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875178210497920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309451.751041:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1788309451.751079:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8efefa680 x1875178210497920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788309467 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788309451.751100:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8efefa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210497920:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788309452.256711:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788309452.256736:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecdc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210498048:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788309452.256812:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309452.259157:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210498048 00000100:00100000:1.0:1788309452.259173:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210498048 00000100:00100000:1.0:1788309452.259249:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788309452.259261:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c89f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210498048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788309452.259351:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788309452.259456:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c89f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210498048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 197us (2643us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309452.259464:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1788309452.262173:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8ecdc2a00 x1875178210498048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788309468 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788309452.262208:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecdc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210498048:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788309452.512832:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309453.538630:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788309453.626940:0:9239:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.45 00010000:00010000:0.0:1788309454.566922:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788309455.387859:0:7639:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 86451057-f8bb-4d7c-a7c2-5c834b43e3d3 00000020:00000080:1.0:1788309455.387873:0:7639:0:(genops.c:885:class_export_put()) final put ffff97c8fc781800/86451057-f8bb-4d7c-a7c2-5c834b43e3d3 00000020:00000080:2.0:1788309455.388830:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff97c8fc781800/86451057-f8bb-4d7c-a7c2-5c834b43e3d3 for lustre-OST0001 00000020:00000080:2.0:1788309455.388901:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97c8fc784000 for lustre-OST0001 00010000:00010000:1.0:1788309455.584823:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788309455.819573:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309455.819609:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309455.819754:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192641920 00000100:00100000:3.0:1788309455.819764:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192641920 00000100:00100000:3.0:1788309455.819818:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 198 00000100:00100000:3.0:1788309455.819829:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6ae9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8351692-8d1a-4b41-bdaf-bf179786ff59+10:2351:x1875178192641920:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788309455.819897:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6ae9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8351692-8d1a-4b41-bdaf-bf179786ff59+10:2351:x1875178192641920:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 70us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309455.819906:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 198 00000100:00100000:0.0:1788309455.821474:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192642048 00000100:00100000:0.0:1788309455.821486:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192642048 00000100:00100000:0.0:1788309455.821553:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 40 00000100:00100000:0.0:1788309455.821564:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8efefb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:2351:x1875178192642048:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788309455.821643:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8efefb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:2351:x1875178192642048:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 80us (2032us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309455.821651:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 40 00000100:00080000:3.0:1788309455.822408:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788309456.354208:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecdc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3303:1875178210498176:0@lo:400:kworker.0 00000100:00100000:1.0:1788309456.354332:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309456.354381:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecdc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875178210498688:0@lo:400:kworker.0 00000100:00100000:1.0:1788309456.354410:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309456.354439:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788309456.354444:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecdc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210498560:0@lo:400:kworker.0 00000100:00100000:1.0:1788309456.354470:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309456.354514:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecdc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875178210498432:0@lo:400:kworker.0 00000100:00100000:1.0:1788309456.354538:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309456.354556:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788309456.354561:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecdc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875178210498304:0@lo:400:kworker.0 00000100:00100000:1.0:1788309456.354583:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309456.354600:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecdc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210498816:0@lo:400:kworker.0 00000100:00100000:1.0:1788309456.354634:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309456.354666:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210498176 00000100:00100000:1.0:1788309456.354673:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210498176 00000100:00100000:1.0:1788309456.354716:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1788309456.354724:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:3303:x1875178210498176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309456.354768:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:3303:x1875178210498176:12345-0@lo:400:kworker.0 Request processed in 44us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309456.354775:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1788309456.354806:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210498688 00000100:00100000:1.0:1788309456.354810:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210498688 00000100:00100000:1.0:1788309456.354839:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210498432 00000100:00100000:1.0:1788309456.354843:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210498432 00000100:00100000:1.0:1788309456.354855:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210498304 00000100:00100000:1.0:1788309456.354857:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210498304 00000100:00100000:1.0:1788309456.354867:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788309456.354878:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8efc4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875178210498688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309456.354906:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8efc4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875178210498688:12345-0@lo:400:kworker.0 Request processed in 28us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309456.354911:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788309456.354922:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788309456.354926:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8efc4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875178210498432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309456.354949:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8efc4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875178210498432:12345-0@lo:400:kworker.0 Request processed in 23us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309456.354955:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788309456.354963:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788309456.354968:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8efc4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875178210498304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309456.354987:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8efc4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875178210498304:12345-0@lo:400:kworker.0 Request processed in 19us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309456.354992:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788309456.355006:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210498560 00000100:00100000:1.0:1788309456.355008:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210498560 00000100:00100000:1.0:1788309456.355028:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210498816 00000100:00100000:1.0:1788309456.355030:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210498816 00000100:00100000:1.0:1788309456.355040:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788309456.355045:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8efc4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210498560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309456.355069:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8efc4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210498560:12345-0@lo:400:kworker.0 Request processed in 24us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309456.355074:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788309456.355082:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788309456.355087:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6b4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875178210498816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309456.355105:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6b4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875178210498816:12345-0@lo:400:kworker.0 Request processed in 18us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309456.355115:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788309456.355159:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecdc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875178210498304:0@lo:400:kworker.0 00010000:00080000:1.0:1788309456.355171:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8ecdc2a00 x1875178210498816/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788309472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788309456.355181:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecdc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210498816:0@lo:400:kworker.0 00000100:00100000:1.0:1788309456.355188:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecdc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875178210498432:0@lo:400:kworker.0 00010000:00080000:1.0:1788309456.355212:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8ecdc0000 x1875178210498560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788309472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788309456.355220:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecdc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210498560:0@lo:400:kworker.0 00000100:00100000:1.0:1788309456.355227:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecdc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3303:1875178210498176:0@lo:400:kworker.0 00000100:00100000:1.0:1788309456.355235:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecdc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875178210498688:0@lo:400:kworker.0 00000100:00080000:3.0:1788309456.357963:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788309456.357975:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788309456.357978:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:2.0:1788309456.390845:0:9337:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.45 00010000:00010000:3.0:1788309456.610389:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788309456.865032:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8efef9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210498944:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788309456.865117:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309456.865592:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210498944 00000100:00100000:0.0:1788309456.865604:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210498944 00000100:00100000:0.0:1788309456.865676:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788309456.865687:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875178210498944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788309456.865723:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788309456.865781:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875178210498944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309456.865790:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1788309456.865930:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8efef9500 x1875178210498944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788309472 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788309456.865951:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8efef9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210498944:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788309457.378582:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e6b4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875178210499072:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788309457.378762:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309457.378919:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210499072 00000100:00100000:0.0:1788309457.378931:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210499072 00000100:00100000:0.0:1788309457.379012:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788309457.379025:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6b4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875178210499072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788309457.379078:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788309457.379744:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6b4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875178210499072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 718us (979us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309457.379771:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1788309457.379875:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8e6b4e680 x1875178210499072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788309473 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788309457.379907:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e6b4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875178210499072:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788309457.635865:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309458.656460:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309459.686476:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788309459.728609:0:9434:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.45 00010000:00010000:0.0:1788309460.706367:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788309460.935692:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309460.935750:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309460.935794:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192642304 00000100:00100000:1.0:1788309460.935807:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192642304 00000100:00100000:1.0:1788309460.935897:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 44 00000100:00100000:1.0:1788309460.935911:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6b4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:2350:x1875178192642304:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788309460.936018:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6b4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:2350:x1875178192642304:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 110us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309460.936027:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 44 00000100:00100000:1.0:1788309460.936057:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192642176 00000100:00100000:1.0:1788309460.936061:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192642176 00000100:00100000:1.0:1788309460.936089:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 200 00000100:00100000:1.0:1788309460.936097:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8351692-8d1a-4b41-bdaf-bf179786ff59+10:2350:x1875178192642176:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788309460.936129:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8351692-8d1a-4b41-bdaf-bf179786ff59+10:2350:x1875178192642176:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 33us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309460.936136:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 200 00000100:00080000:1.0:1788309460.936167:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:3.0:1788309461.433955:0:9482:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Tue Sep 1 20:37:39 EDT 2026 00000100:00100000:3.0:1788309461.473718:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8efefa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875178210499584:0@lo:400:kworker.0 00000100:00100000:3.0:1788309461.473889:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309461.473990:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8efefbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875178210499328:0@lo:400:kworker.0 00000100:00100000:3.0:1788309461.474025:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309461.474047:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8efef9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210499840:0@lo:400:kworker.0 00000100:00100000:3.0:1788309461.474071:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309461.474101:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788309461.474107:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8efef8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875178210499456:0@lo:400:kworker.0 00000100:00100000:3.0:1788309461.474128:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309461.474467:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210499584 00000100:00100000:1.0:1788309461.474478:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210499584 00000100:00100000:1.0:1788309461.474553:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210499840 00000100:00100000:1.0:1788309461.474557:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210499840 00000100:00100000:1.0:1788309461.474655:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788309461.474669:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6979f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875178210499584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309461.475656:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6979f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875178210499584:12345-0@lo:400:kworker.0 Request processed in 983us (1760us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309461.475667:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788309461.475702:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788309461.475712:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e697a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1875178210499840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309461.475851:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e697a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1875178210499840:12345-0@lo:400:kworker.0 Request processed in 141us (1778us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309461.475858:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788309461.475883:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210499328 00000100:00100000:1.0:1788309461.475889:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210499328 00000100:00100000:1.0:1788309461.475919:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210499456 00000100:00100000:1.0:1788309461.475922:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210499456 00000100:00100000:1.0:1788309461.475941:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788309461.475947:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6978a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875178210499328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309461.475979:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6978a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875178210499328:12345-0@lo:400:kworker.0 Request processed in 32us (1953us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309461.475985:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788309461.475995:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788309461.476000:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6978000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875178210499456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309461.476023:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6978000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875178210499456:12345-0@lo:400:kworker.0 Request processed in 23us (1894us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309461.476029:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:1.0:1788309461.476052:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788309461.476057:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788309461.476059:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788309461.476104:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8efefa300 x1875178210499584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788309477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788309461.476122:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8efefa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875178210499584:0@lo:400:kworker.0 00000100:00100000:2.0:1788309461.476448:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8efef8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3303:1875178210499200:0@lo:400:kworker.0 00000100:00100000:2.0:1788309461.476498:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309461.476536:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8efef9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875178210499712:0@lo:400:kworker.0 00000100:00100000:2.0:1788309461.476561:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309461.476607:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210499200 00000100:00100000:2.0:1788309461.476611:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210499200 00000100:00100000:2.0:1788309461.476642:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1788309461.476649:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:3303:x1875178210499200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309461.476698:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:3303:x1875178210499200:12345-0@lo:400:kworker.0 Request processed in 49us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309461.476704:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1788309461.476739:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8efef8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3303:1875178210499200:0@lo:400:kworker.0 00000100:00100000:3.0:1788309461.476982:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8efef8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875178210499456:0@lo:400:kworker.0 00000100:00100000:3.0:1788309461.476995:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8efefbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875178210499328:0@lo:400:kworker.0 00010000:00080000:3.0:1788309461.477009:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8efef9880 x1875178210499840/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788309477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788309461.477020:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8efef9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210499840:0@lo:400:kworker.0 00000100:00100000:1.0:1788309461.478506:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210499712 00000100:00100000:1.0:1788309461.478523:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210499712 00000100:00080000:3.0:1788309461.478967:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788309461.479189:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788309461.479202:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8efef8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875178210499712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309461.480302:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8efef8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875178210499712:12345-0@lo:400:kworker.0 Request processed in 1069us (3705us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309461.480316:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788309461.485196:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8efef9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875178210499712:0@lo:400:kworker.0 00010000:00010000:3.0:1788309461.729093:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788309461.986133:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8efef9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210499968:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788309461.986325:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309461.986861:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210499968 00000100:00100000:3.0:1788309461.986874:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210499968 00000100:00100000:3.0:1788309461.986975:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788309461.986988:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6b4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875178210499968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788309461.987036:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788309461.987109:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6b4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875178210499968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (784us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309461.987117:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1788309461.987203:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8efef9c00 x1875178210499968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788309477 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788309461.987237:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8efef9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210499968:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788309462.496461:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788309462.496494:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e6b4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210500096:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788309462.496593:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309462.496669:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210500096 00000100:00100000:0.0:1788309462.496680:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210500096 00000100:00100000:0.0:1788309462.496763:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788309462.496776:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6b4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210500096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788309462.496824:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788309462.496878:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6b4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210500096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309462.496886:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1788309462.498132:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8e6b4ea00 x1875178210500096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788309478 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788309462.498171:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e6b4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210500096:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788309462.752511:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309463.777683:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309464.803227:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309465.824707:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788309466.053500:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309466.053563:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309466.053581:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192642432 00000100:00100000:2.0:1788309466.053596:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192642432 00000100:00100000:3.0:1788309466.053654:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192642560 00000100:00100000:3.0:1788309466.053670:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192642560 00000100:00100000:2.0:1788309466.053681:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 202 00000100:00100000:2.0:1788309466.053697:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8351692-8d1a-4b41-bdaf-bf179786ff59+10:2351:x1875178192642432:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788309466.053759:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 48 00000100:00100000:3.0:1788309466.053776:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:2351:x1875178192642560:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:2.0:1788309466.053818:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8351692-8d1a-4b41-bdaf-bf179786ff59+10:2351:x1875178192642432:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 123us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309466.053829:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 202 00000100:00100000:3.0:1788309466.053856:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:2351:x1875178192642560:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 85us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309466.053887:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 48 00000100:00080000:3.0:1788309466.054008:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788309466.596943:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788309466.596974:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e6b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875178210500352:0@lo:400:kworker.0 00000100:00100000:1.0:1788309466.597066:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309466.597163:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e6b4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875178210500480:0@lo:400:kworker.0 00000100:00100000:1.0:1788309466.597196:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309466.597238:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210500352 00000100:00100000:1.0:1788309466.597266:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210500352 00000100:00100000:1.0:1788309466.597365:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210500480 00000100:00100000:1.0:1788309466.597368:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210500480 00000100:00100000:1.0:1788309466.597408:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788309466.597418:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875178210500352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309466.597492:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875178210500352:12345-0@lo:400:kworker.0 Request processed in 74us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309466.597501:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788309466.597520:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788309466.597527:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6b4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875178210500480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309466.597568:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6b4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875178210500480:12345-0@lo:400:kworker.0 Request processed in 42us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309466.597575:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:1.0:1788309466.597598:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788309466.597648:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e6b4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875178210500480:0@lo:400:kworker.0 00000100:00100000:1.0:1788309466.597661:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e6b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875178210500352:0@lo:400:kworker.0 00000100:00100000:1.0:1788309466.597722:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788309466.597728:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e6b4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210500864:0@lo:400:kworker.0 00000100:00100000:1.0:1788309466.597762:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309466.597797:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210500864 00000100:00100000:1.0:1788309466.597801:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210500864 00000100:00100000:1.0:1788309466.597834:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788309466.597842:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6b4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875178210500864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309466.597881:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6b4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875178210500864:12345-0@lo:400:kworker.0 Request processed in 40us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309466.597887:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1788309466.597916:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788309466.597935:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8e6b4dc00 x1875178210500864/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788309482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788309466.597948:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e6b4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210500864:0@lo:400:kworker.0 00000100:00100000:0.0:1788309466.598055:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e6b4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3303:1875178210500224:0@lo:400:kworker.0 00000100:00100000:0.0:1788309466.598098:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309466.598132:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e6b4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875178210500736:0@lo:400:kworker.0 00000100:00100000:0.0:1788309466.598158:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309466.598191:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788309466.598197:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e6b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210500608:0@lo:400:kworker.0 00000100:00100000:0.0:1788309466.598220:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309466.598256:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210500608 00000100:00100000:0.0:1788309466.598259:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210500608 00000100:00100000:0.0:1788309466.598314:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788309466.598322:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c89f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210500608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309466.598359:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c89f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210500608:12345-0@lo:400:kworker.0 Request processed in 38us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309466.598365:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1788309466.598392:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8e6b4c700 x1875178210500608/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788309482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788309466.598411:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e6b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210500608:0@lo:400:kworker.0 00000100:00080000:0.0:1788309466.598426:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788309466.598438:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210500736 00000100:00100000:0.0:1788309466.598442:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210500736 00000100:00100000:0.0:1788309466.598472:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788309466.598478:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c89f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875178210500736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309466.598511:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c89f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875178210500736:12345-0@lo:400:kworker.0 Request processed in 34us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309466.598518:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788309466.598541:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e6b4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875178210500736:0@lo:400:kworker.0 00000100:00080000:0.0:1788309466.598557:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788309466.599258:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210500224 00000100:00100000:1.0:1788309466.599267:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210500224 00000100:00100000:1.0:1788309466.601222:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1788309466.601238:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:3303:x1875178210500224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309466.601544:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:3303:x1875178210500224:12345-0@lo:400:kworker.0 Request processed in 310us (3444us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309466.601553:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1788309466.601735:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e6b4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3303:1875178210500224:0@lo:400:kworker.0 00010000:00010000:3.0:1788309466.850140:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788309467.105800:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8efef8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210500992:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788309467.105906:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309467.106054:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210500992 00000100:00100000:2.0:1788309467.106067:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210500992 00000100:00100000:2.0:1788309467.106145:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788309467.106159:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875178210500992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788309467.106220:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788309467.106316:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875178210500992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 159us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309467.106325:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1788309467.106419:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8efef8700 x1875178210500992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788309483 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788309467.106443:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8efef8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210500992:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788309467.616920:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788309467.616953:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8efef9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210501120:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788309467.617047:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309467.617163:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210501120 00000100:00100000:2.0:1788309467.617183:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210501120 00000100:00100000:2.0:1788309467.617251:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788309467.617264:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210501120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788309467.617376:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788309467.617435:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210501120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 173us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309467.617443:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1788309467.617491:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8efef9180 x1875178210501120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788309483 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788309467.617514:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8efef9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210501120:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788309467.874123:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309468.898668:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309469.923636:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309470.945384:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788309471.177501:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309471.177551:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309471.177624:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192642688 00000100:00100000:0.0:1788309471.177635:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192642688 00000100:00100000:0.0:1788309471.177695:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 204 00000100:00100000:0.0:1788309471.177706:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8351692-8d1a-4b41-bdaf-bf179786ff59+10:2352:x1875178192642688:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788309471.177769:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8351692-8d1a-4b41-bdaf-bf179786ff59+10:2352:x1875178192642688:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 64us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309471.177776:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 204 00000100:00100000:1.0:1788309471.177835:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192642816 00000100:00100000:1.0:1788309471.177839:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192642816 00000100:00100000:1.0:1788309471.177887:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 52 00000100:00100000:1.0:1788309471.177895:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8efef9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:2353:x1875178192642816:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788309471.177922:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8efef9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:2353:x1875178192642816:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 30us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309471.177938:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 52 00000100:00080000:0.0:1788309471.178145:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788309471.713619:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8c89fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3303:1875178210501248:0@lo:400:kworker.0 00000100:00100000:0.0:1788309471.713710:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309471.713759:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffcaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875178210501760:0@lo:400:kworker.0 00000100:00100000:0.0:1788309471.713795:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309471.716191:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788309471.716209:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffcab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210501632:0@lo:400:kworker.0 00000100:00100000:0.0:1788309471.716956:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309471.717019:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffca9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875178210501376:0@lo:400:kworker.0 00000100:00100000:0.0:1788309471.717050:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309471.717085:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffcaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210501888:0@lo:400:kworker.0 00000100:00100000:0.0:1788309471.717109:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309471.717140:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788309471.717147:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffca8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875178210501504:0@lo:400:kworker.0 00000100:00100000:0.0:1788309471.717170:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309471.717207:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210501248 00000100:00100000:0.0:1788309471.717215:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210501248 00000100:00100000:0.0:1788309471.717290:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1788309471.717301:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:3303:x1875178210501248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309471.717756:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:3303:x1875178210501248:12345-0@lo:400:kworker.0 Request processed in 456us (4044us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309471.717764:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1788309471.717801:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210501760 00000100:00100000:0.0:1788309471.717806:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210501760 00000100:00100000:0.0:1788309471.717843:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210501376 00000100:00100000:0.0:1788309471.717846:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210501376 00000100:00100000:0.0:1788309471.717856:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210501504 00000100:00100000:0.0:1788309471.717858:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210501504 00000100:00100000:0.0:1788309471.717871:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788309471.717878:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffcab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875178210501760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309471.717909:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffcab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875178210501760:12345-0@lo:400:kworker.0 Request processed in 32us (4114us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309471.717922:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788309471.717934:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788309471.717940:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffcaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875178210501376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309471.717971:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffcaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875178210501376:12345-0@lo:400:kworker.0 Request processed in 32us (920us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309471.717976:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788309471.717985:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788309471.717990:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffca9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875178210501504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309471.718014:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffca9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875178210501504:12345-0@lo:400:kworker.0 Request processed in 24us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309471.718020:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788309471.718042:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210501632 00000100:00100000:0.0:1788309471.718045:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210501632 00000100:00100000:0.0:1788309471.718082:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210501888 00000100:00100000:0.0:1788309471.718085:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210501888 00000100:00100000:0.0:1788309471.718100:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788309471.718105:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffca8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210501632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309471.718148:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffca8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210501632:12345-0@lo:400:kworker.0 Request processed in 42us (1195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309471.718153:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788309471.718165:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788309471.718170:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffcab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1875178210501888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309471.718196:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffcab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1875178210501888:12345-0@lo:400:kworker.0 Request processed in 26us (1087us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309471.718201:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1788309471.718233:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788309471.718237:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788309471.718239:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788309471.721680:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffca8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875178210501504:0@lo:400:kworker.0 00000100:00100000:0.0:1788309471.721708:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffca9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875178210501376:0@lo:400:kworker.0 00010000:00080000:0.0:1788309471.721724:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8ffcaa680 x1875178210501888/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788309487 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788309471.721737:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffcaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210501888:0@lo:400:kworker.0 00010000:00080000:0.0:1788309471.721779:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8ffcab100 x1875178210501632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788309487 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788309471.721789:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffcab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210501632:0@lo:400:kworker.0 00000100:00100000:0.0:1788309471.721800:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8c89fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3303:1875178210501248:0@lo:400:kworker.0 00000100:00100000:0.0:1788309471.721811:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffcaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875178210501760:0@lo:400:kworker.0 00010000:00010000:1.0:1788309471.972698:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788309472.224576:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788309472.224611:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8efef9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210502016:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788309472.224717:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309472.224817:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210502016 00000100:00100000:2.0:1788309472.224827:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210502016 00000100:00100000:2.0:1788309472.224886:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788309472.224896:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8efef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875178210502016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788309472.224942:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788309472.224995:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8efef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875178210502016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309472.225002:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1788309472.225048:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8efef9f80 x1875178210502016/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788309488 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788309472.225071:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8efef9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210502016:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788309472.736725:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8efef9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875178210502144:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788309472.736829:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309472.736979:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210502144 00000100:00100000:2.0:1788309472.736999:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210502144 00000100:00100000:2.0:1788309472.737070:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788309472.737082:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e697bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875178210502144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788309472.737140:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788309472.737214:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e697bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875178210502144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 134us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309472.737223:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1788309472.737272:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8efef9f80 x1875178210502144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788309488 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788309472.737330:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8efef9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875178210502144:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788309472.992556:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309474.019817:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309475.040761:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309476.065338:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788309476.298617:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309476.298769:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192642944 00000100:00100000:1.0:1788309476.298784:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192642944 00000100:00100000:1.0:1788309476.298882:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 206 00000100:00100000:1.0:1788309476.298896:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8351692-8d1a-4b41-bdaf-bf179786ff59+10:2351:x1875178192642944:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788309476.299004:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8351692-8d1a-4b41-bdaf-bf179786ff59+10:2351:x1875178192642944:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 110us (6538us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309476.299013:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 206 00000100:00100000:1.0:1788309476.307639:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309476.307770:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192643072 00000100:00100000:2.0:1788309476.307784:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192643072 00000100:00100000:2.0:1788309476.307896:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 56 00000100:00100000:2.0:1788309476.307910:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6b4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:2351:x1875178192643072:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:2.0:1788309476.308011:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6b4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:2351:x1875178192643072:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 104us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309476.308019:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 56 00000100:00080000:1.0:1788309476.308832:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788309476.832564:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffca9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875178210502656:0@lo:400:kworker.0 00000100:00100000:0.0:1788309476.832661:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309476.832917:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffcaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875178210502528:0@lo:400:kworker.0 00000100:00100000:1.0:1788309476.832955:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309476.833047:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffcaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3303:1875178210502272:0@lo:400:kworker.0 00000100:00100000:3.0:1788309476.833103:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309476.834317:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffcab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875178210502400:0@lo:400:kworker.0 00000100:00100000:0.0:1788309476.834380:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309476.834415:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffca8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210502912:0@lo:400:kworker.0 00000100:00100000:0.0:1788309476.834529:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309476.834573:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210502656 00000100:00100000:0.0:1788309476.834582:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210502656 00000100:00100000:0.0:1788309476.834646:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210502912 00000100:00100000:0.0:1788309476.834649:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210502912 00000100:00100000:0.0:1788309476.834667:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788309476.834688:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffcabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875178210502656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309476.834751:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffcabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875178210502656:12345-0@lo:400:kworker.0 Request processed in 65us (2091us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309476.834759:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788309476.834777:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788309476.834783:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffcaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1875178210502912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309476.834812:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffcaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1875178210502912:12345-0@lo:400:kworker.0 Request processed in 29us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309476.834818:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1788309476.834884:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8ffca8700 x1875178210502912/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788309492 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788309476.834900:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffca8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210502912:0@lo:400:kworker.0 00000100:00100000:2.0:1788309476.835338:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210502528 00000100:00100000:2.0:1788309476.835344:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210502528 00000100:00100000:2.0:1788309476.835383:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210502400 00000100:00100000:2.0:1788309476.835387:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210502400 00000100:00100000:2.0:1788309476.835406:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788309476.835413:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6b4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875178210502528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309476.835475:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6b4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875178210502528:12345-0@lo:400:kworker.0 Request processed in 63us (2519us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309476.835488:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788309476.835503:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788309476.835508:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffca8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875178210502400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309476.835543:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffca8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875178210502400:12345-0@lo:400:kworker.0 Request processed in 35us (1163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309476.835549:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788309476.835585:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffcab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875178210502400:0@lo:400:kworker.0 00000100:00100000:2.0:1788309476.836381:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210502272 00000100:00100000:2.0:1788309476.836393:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210502272 00000100:00100000:2.0:1788309476.836507:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1788309476.836516:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:3303:x1875178210502272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309476.836575:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:3303:x1875178210502272:12345-0@lo:400:kworker.0 Request processed in 61us (3472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309476.836582:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788309476.837599:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffcaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875178210502528:0@lo:400:kworker.0 00000100:00080000:1.0:1788309476.837655:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788309476.837663:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788309476.837666:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788309476.838390:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8ffca9f80 x1875178210502656/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788309492 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788309476.838406:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffca9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875178210502656:0@lo:400:kworker.0 00000100:00100000:3.0:1788309476.838579:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffcaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3303:1875178210502272:0@lo:400:kworker.0 00000100:00100000:3.0:1788309476.838593:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffca8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875178210502784:0@lo:400:kworker.0 00000100:00100000:3.0:1788309476.838665:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309476.838835:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210502784 00000100:00100000:1.0:1788309476.838844:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210502784 00000100:00100000:1.0:1788309476.838916:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788309476.838926:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6978700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875178210502784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309476.838995:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6978700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875178210502784:12345-0@lo:400:kworker.0 Request processed in 70us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309476.839003:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788309476.839066:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffca8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875178210502784:0@lo:400:kworker.0 00000100:00080000:2.0:1788309476.839114:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:0.0:1788309476.872080:0:10113:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 20:37:55 (1788309475) === 00010000:00010000:0.0:1788309477.092967:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788309477.301141:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309477.301328:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192643200 00000100:00100000:0.0:1788309477.301340:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192643200 00000100:00100000:0.0:1788309477.301396:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 208 00000100:00100000:0.0:1788309477.301408:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8351692-8d1a-4b41-bdaf-bf179786ff59+10:8115:x1875178192643200:12345-192.168.202.55@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788309477.301435:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788309477.301561:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c8d73eea00/0x63a04852f46286d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8a28c761146a91a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309477.301596:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8d73eea00/0x63a04852f46286d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a91a expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309477.301609:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c8d73eea00/0x63a04852f46286d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a91a expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309477.301634:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8d73eea00, rc 0) 00000100:00100000:0.0:1788309477.301697:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8351692-8d1a-4b41-bdaf-bf179786ff59+11:8115:x1875178192643200:12345-192.168.202.55@tcp:101:mount.lustre.0 Request processed in 291us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309477.301704:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 208 00000100:00100000:2.0:1788309477.307582:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309477.312946:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192643328 00000100:00100000:1.0:1788309477.312960:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192643328 00000100:00100000:1.0:1788309477.313141:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 209 00000100:00100000:1.0:1788309477.313154:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8351692-8d1a-4b41-bdaf-bf179786ff59+11:8115:x1875178192643328:12345-192.168.202.55@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788309477.313505:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8351692-8d1a-4b41-bdaf-bf179786ff59+11:8115:x1875178192643328:12345-192.168.202.55@tcp:501:mount.lustre.0 Request processed in 352us (5932us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309477.313515:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 209 00000100:00100000:1.0:1788309477.322970:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309477.323074:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192643456 00000100:00100000:2.0:1788309477.323096:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192643456 00000100:00100000:2.0:1788309477.323152:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 210 00000100:00100000:2.0:1788309477.323162:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8351692-8d1a-4b41-bdaf-bf179786ff59+11:8115:x1875178192643456:12345-192.168.202.55@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788309477.323446:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8351692-8d1a-4b41-bdaf-bf179786ff59+11:8115:x1875178192643456:12345-192.168.202.55@tcp:503:mount.lustre.0 Request processed in 285us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309477.323455:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 210 00000100:00100000:2.0:1788309477.328754:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309477.328935:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192643584 00000100:00100000:1.0:1788309477.328946:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192643584 00000100:00100000:1.0:1788309477.329004:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 211 00000100:00100000:1.0:1788309477.329015:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8351692-8d1a-4b41-bdaf-bf179786ff59+11:8119:x1875178192643584:12345-192.168.202.55@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788309477.329371:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8351692-8d1a-4b41-bdaf-bf179786ff59+11:8119:x1875178192643584:12345-192.168.202.55@tcp:502:llog_process_th.0 Request processed in 355us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309477.329380:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 211 00000100:00100000:0.0:1788309477.344732:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788309477.344758:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8efef9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210503040:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788309477.344839:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309477.345134:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210503040 00000100:00100000:2.0:1788309477.345142:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210503040 00000100:00100000:2.0:1788309477.345201:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788309477.345210:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffca8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875178210503040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788309477.345247:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788309477.345324:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffca8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875178210503040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309477.345332:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1788309477.345463:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8efef9f80 x1875178210503040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788309493 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788309477.345482:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8efef9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210503040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788309477.347540:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309477.347725:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192643712 00000100:00100000:0.0:1788309477.347738:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192643712 00000100:00100000:0.0:1788309477.347807:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 212 00000100:00100000:0.0:1788309477.347818:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8351692-8d1a-4b41-bdaf-bf179786ff59+11:8119:x1875178192643712:12345-192.168.202.55@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788309477.348328:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8351692-8d1a-4b41-bdaf-bf179786ff59+11:8119:x1875178192643712:12345-192.168.202.55@tcp:502:llog_process_th.0 Request processed in 510us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309477.348337:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 212 00000100:00100000:3.0:1788309477.357128:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309477.357263:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192643840 00000100:00100000:2.0:1788309477.357349:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192643840 00000100:00100000:2.0:1788309477.357433:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 213 00000100:00100000:2.0:1788309477.357445:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8351692-8d1a-4b41-bdaf-bf179786ff59+11:8115:x1875178192643840:12345-192.168.202.55@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788309477.357466:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309477.357484:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c8e26d9e00/0x63a04852f46286d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8a28c761146a944 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309477.357514:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8e26d9e00/0x63a04852f46286d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a944 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309477.357526:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c8e26d9e00/0x63a04852f46286d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a944 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309477.357536:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8e26d9e00, rc 0) 00000100:00100000:2.0:1788309477.357618:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8351692-8d1a-4b41-bdaf-bf179786ff59+12:8115:x1875178192643840:12345-192.168.202.55@tcp:101:mount.lustre.0 Request processed in 175us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309477.357624:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 213 00000100:00100000:2.0:1788309477.362963:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309477.363157:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192643968 00000100:00100000:0.0:1788309477.363173:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192643968 00000100:00100000:0.0:1788309477.363249:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 214 00000100:00100000:0.0:1788309477.363260:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8351692-8d1a-4b41-bdaf-bf179786ff59+12:8115:x1875178192643968:12345-192.168.202.55@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788309477.363341:0:5831:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788309477.363368:0:5831:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788309477.363372:0:5831:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788309477.363381:0:5831:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788309477.363384:0:5831:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1788309477.365101:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8351692-8d1a-4b41-bdaf-bf179786ff59+12:8115:x1875178192643968:12345-192.168.202.55@tcp:256:mount.lustre.0 Request processed in 1816us (2126us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309477.365119:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 214 00000100:00100000:3.0:1788309477.367677:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309477.367859:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192644096 00000100:00100000:1.0:1788309477.367872:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192644096 00000100:00100000:1.0:1788309477.367943:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 215 00000100:00100000:1.0:1788309477.367956:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8351692-8d1a-4b41-bdaf-bf179786ff59+12:8115:x1875178192644096:12345-192.168.202.55@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788309477.367980:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788309477.368004:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c8f5549e00/0x63a04852f46286e0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8a28c761146a94b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309477.368067:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8f5549e00/0x63a04852f46286e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a94b expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309477.368091:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c8f5549e00/0x63a04852f46286e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a94b expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309477.368104:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8f5549e00, rc 0) 00000100:00100000:1.0:1788309477.368331:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8351692-8d1a-4b41-bdaf-bf179786ff59+13:8115:x1875178192644096:12345-192.168.202.55@tcp:101:mount.lustre.0 Request processed in 376us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309477.368339:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 215 00000100:00100000:2.0:1788309477.372810:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309477.373040:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192644224 00000100:00100000:0.0:1788309477.373054:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192644224 00000100:00100000:0.0:1788309477.373135:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 216 00000100:00100000:0.0:1788309477.373149:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8351692-8d1a-4b41-bdaf-bf179786ff59+13:8115:x1875178192644224:12345-192.168.202.55@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788309477.373620:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8351692-8d1a-4b41-bdaf-bf179786ff59+13:8115:x1875178192644224:12345-192.168.202.55@tcp:501:mount.lustre.0 Request processed in 472us (823us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309477.373631:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 216 00000100:00100000:3.0:1788309477.376181:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309477.376326:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192644352 00000100:00100000:2.0:1788309477.376336:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192644352 00000100:00100000:2.0:1788309477.376392:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 217 00000100:00100000:2.0:1788309477.376402:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8351692-8d1a-4b41-bdaf-bf179786ff59+13:8115:x1875178192644352:12345-192.168.202.55@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788309477.376706:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8351692-8d1a-4b41-bdaf-bf179786ff59+13:8115:x1875178192644352:12345-192.168.202.55@tcp:503:mount.lustre.0 Request processed in 304us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309477.376714:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 217 00000100:00100000:3.0:1788309477.382254:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309477.382623:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192644480 00000100:00100000:1.0:1788309477.382638:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192644480 00000100:00100000:1.0:1788309477.382703:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 218 00000100:00100000:1.0:1788309477.382713:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8351692-8d1a-4b41-bdaf-bf179786ff59+13:8123:x1875178192644480:12345-192.168.202.55@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788309477.383046:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8351692-8d1a-4b41-bdaf-bf179786ff59+13:8123:x1875178192644480:12345-192.168.202.55@tcp:502:llog_process_th.0 Request processed in 332us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309477.383055:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 218 00000100:00100000:1.0:1788309477.386774:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309477.387127:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192644608 00000100:00100000:0.0:1788309477.387144:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192644608 00000100:00100000:0.0:1788309477.387369:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 219 00000100:00100000:0.0:1788309477.387385:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8351692-8d1a-4b41-bdaf-bf179786ff59+13:8123:x1875178192644608:12345-192.168.202.55@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788309477.387756:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8351692-8d1a-4b41-bdaf-bf179786ff59+13:8123:x1875178192644608:12345-192.168.202.55@tcp:502:llog_process_th.0 Request processed in 375us (995us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309477.387766:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 219 00000100:00100000:3.0:1788309477.390495:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309477.393357:0:8305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192644864 00000100:00100000:2.0:1788309477.393380:0:8305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192644864 00000100:00100000:2.0:1788309477.393478:0:8305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 60 00000100:00100000:2.0:1788309477.393492:0:8305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6979500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:2352:x1875178192644864:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:2.0:1788309477.393634:0:8305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6979500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:2352:x1875178192644864:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 146us (3151us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309477.393643:0:8305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 60 00000100:00100000:1.0:1788309477.399167:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309477.399503:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192644736 00000100:00100000:2.0:1788309477.399517:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192644736 00000100:00100000:2.0:1788309477.399586:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 10 00000100:00100000:2.0:1788309477.399599:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2349:x1875178192644736:12345-192.168.202.55@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788309477.399646:0:5839:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from ea7f0717-c12d-4408-bdfd-5a035f695b73@192.168.202.55@tcp t0 exp 0000000000000000 cur 240 last 0 00000020:00000080:2.0:1788309477.399708:0:5839:0:(genops.c:1385:class_connect()) connect: client ea7f0717-c12d-4408-bdfd-5a035f695b73, cookie 0x63a04852f46286e7 00000004:00100000:2.0:1788309477.400008:0:5839:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788309477.400437:0:5839:0:(import.c:65:import_set_state_nolock()) ffff97c8eff03800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788309477.400728:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ea7f0717-c12d-4408-bdfd-5a035f695b73+6:2349:x1875178192644736:12345-192.168.202.55@tcp:38:mount.lustre.0 Request processed in 1128us (1573us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309477.400757:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 10 00000100:00100000:3.0:1788309477.405349:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309477.406742:0:8305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192645120 00000100:00100000:2.0:1788309477.406833:0:8305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192645120 00000100:00100000:1.0:1788309477.406899:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309477.407011:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192644992 00000100:00100000:0.0:1788309477.407017:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192644992 00000100:00100000:2.0:1788309477.407046:0:8305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 11 00000100:00100000:2.0:1788309477.407060:0:8305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f4ce3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ea7f0717-c12d-4408-bdfd-5a035f695b73+7:8115:x1875178192645120:12345-192.168.202.55@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788309477.407135:0:8305:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788309477.407262:0:8305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f4ce3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ea7f0717-c12d-4408-bdfd-5a035f695b73+7:8115:x1875178192645120:12345-192.168.202.55@tcp:41:mount.lustre.0 Request processed in 204us (1927us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309477.407945:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 12 00000100:00100000:0.0:1788309477.407964:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6b4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ea7f0717-c12d-4408-bdfd-5a035f695b73+7:0:x1875178192644992:12345-192.168.202.55@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788309477.407989:0:5838:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788309477.408037:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6b4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ea7f0717-c12d-4408-bdfd-5a035f695b73+7:0:x1875178192644992:12345-192.168.202.55@tcp:41:mount.lustre.0 Request processed in 82us (1144us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309477.408067:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 12 00000100:00080000:3.0:1788309477.408255:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788309477.408537:0:8305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 11 00000100:00100000:3.0:1788309477.415180:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309477.415312:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192645248 00000100:00100000:0.0:1788309477.415325:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192645248 00000100:00100000:0.0:1788309477.415397:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 13 00000100:00100000:0.0:1788309477.415409:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f4ce0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ea7f0717-c12d-4408-bdfd-5a035f695b73+6:8115:x1875178192645248:12345-192.168.202.55@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788309477.416429:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f4ce0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ea7f0717-c12d-4408-bdfd-5a035f695b73+6:8115:x1875178192645248:12345-192.168.202.55@tcp:40:mount.lustre.0 Request processed in 1015us (1256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309477.416563:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 13 00000100:00100000:0.0:1788309477.432324:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309477.432373:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309477.432382:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192645632 00000100:00100000:2.0:1788309477.432397:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192645632 00000100:00100000:0.0:1788309477.432469:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309477.432530:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 1 00000100:00100000:3.0:1788309477.432651:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffca9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ea7f0717-c12d-4408-bdfd-5a035f695b73+6:8115:x1875178192645632:12345-192.168.202.55@tcp:33:mount.lustre.0 00000100:00100000:1.0:1788309477.432970:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192645376 00000100:00100000:1.0:1788309477.432976:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192645376 00000100:00100000:1.0:1788309477.433101:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192645504 00000100:00100000:1.0:1788309477.433105:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192645504 00000100:00100000:1.0:1788309477.433120:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 12 00000100:00100000:1.0:1788309477.433126:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffca9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2349:x1875178192645376:12345-192.168.202.55@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788309477.433162:0:6681:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from ea7f0717-c12d-4408-bdfd-5a035f695b73@192.168.202.55@tcp t0 exp 0000000000000000 cur 240 last 0 00000004:00200000:3.0:1788309477.433270:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000020:00000080:1.0:1788309477.433429:0:6681:0:(genops.c:1385:class_connect()) connect: client ea7f0717-c12d-4408-bdfd-5a035f695b73, cookie 0x63a04852f46286ee 00002000:00100000:1.0:1788309477.433523:0:6681:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ea7f0717-c12d-4408-bdfd-5a035f695b73/ffff97c8f52d6800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392d ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788309477.433554:0:6681:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1788309477.433760:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffca9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ea7f0717-c12d-4408-bdfd-5a035f695b73+6:8115:x1875178192645632:12345-192.168.202.55@tcp:33:mount.lustre.0 Request processed in 1214us (1488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309477.433770:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 1 00002000:00080000:1.0:1788309477.433917:0:6681:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788309477.433955:0:6681:0:(import.c:65:import_set_state_nolock()) ffff97c8f52d4800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788309477.434832:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffca9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ea7f0717-c12d-4408-bdfd-5a035f695b73+6:2349:x1875178192645376:12345-192.168.202.55@tcp:8:mount.lustre.0 Request processed in 866us (1620us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309477.434846:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 12 00000100:00100000:1.0:1788309477.434873:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 13 00000100:00100000:1.0:1788309477.434879:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffca8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2349:x1875178192645504:12345-192.168.202.55@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788309477.434907:0:6681:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from ea7f0717-c12d-4408-bdfd-5a035f695b73@192.168.202.55@tcp t0 exp 0000000000000000 cur 240 last 0 00000020:00000080:1.0:1788309477.434936:0:6681:0:(genops.c:1385:class_connect()) connect: client ea7f0717-c12d-4408-bdfd-5a035f695b73, cookie 0x63a04852f46286f5 00002000:00100000:1.0:1788309477.434947:0:6681:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ea7f0717-c12d-4408-bdfd-5a035f695b73/ffff97c8f52d1800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392d ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788309477.434956:0:6681:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788309477.435211:0:6681:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788309477.435240:0:6681:0:(import.c:65:import_set_state_nolock()) ffff97c8f52d7000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788309477.435340:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffca8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ea7f0717-c12d-4408-bdfd-5a035f695b73+6:2349:x1875178192645504:12345-192.168.202.55@tcp:8:mount.lustre.0 Request processed in 458us (2869us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309477.435348:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 13 00000100:00100000:3.0:1788309477.856713:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788309477.856979:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8efefb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210503168:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788309477.857147:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309477.857319:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210503168 00000100:00100000:0.0:1788309477.857330:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210503168 00000100:00100000:0.0:1788309477.857399:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788309477.857411:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f4ce0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210503168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788309477.857454:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788309477.857513:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f4ce0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210503168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309477.857521:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1788309477.857679:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8efefb100 x1875178210503168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788309493 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788309477.857709:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8efefb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210503168:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788309478.112668:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309479.141641:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309480.164787:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788309480.475586:0:5859:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ea7f0717-c12d-4408-bdfd-5a035f695b73 00000001:00100000:1.0:1788309481.027844:0:7639:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ea7f0717-c12d-4408-bdfd-5a035f695b73 00010000:00010000:0.0:1788309481.185659:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788309481.955339:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffca8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875178210503424:0@lo:400:kworker.0 00000100:00100000:2.0:1788309481.955367:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffca9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875178210503680:0@lo:400:kworker.0 00000100:00100000:1.0:1788309481.955562:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffcaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875178210503552:0@lo:400:kworker.0 00000100:00100000:3.0:1788309481.955630:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffca9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3303:1875178210503296:0@lo:400:kworker.0 00000100:00100000:0.0:1788309481.960219:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309481.960336:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffcab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210503936:0@lo:400:kworker.0 00000100:00100000:0.0:1788309481.963406:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309481.963513:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210503424 00000100:00100000:0.0:1788309481.963524:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210503424 00000100:00100000:0.0:1788309481.963591:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788309481.963603:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c89fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875178210503424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309481.963661:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c89fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875178210503424:12345-0@lo:400:kworker.0 Request processed in 60us (3450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309481.963668:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788309481.963714:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffca8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875178210503424:0@lo:400:kworker.0 00000100:00100000:2.0:1788309481.964238:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309481.966513:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210503936 00000100:00100000:2.0:1788309481.966527:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210503936 00000100:00100000:2.0:1788309481.966580:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210503680 00000100:00100000:2.0:1788309481.966583:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210503680 00000100:00100000:2.0:1788309481.966604:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788309481.966613:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc768380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1875178210503936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309481.966713:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc768380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1875178210503936:12345-0@lo:400:kworker.0 Request processed in 100us (3320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309481.966721:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788309481.966740:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788309481.966793:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8efefb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875178210503680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309481.966828:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8efefb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875178210503680:12345-0@lo:400:kworker.0 Request processed in 37us (2591us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309481.966833:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1788309481.966947:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8ffcab100 x1875178210503936/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788309497 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788309481.966989:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffcab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210503936:0@lo:400:kworker.0 00010000:00080000:2.0:1788309481.967021:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8ffca9f80 x1875178210503680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788309497 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788309481.967031:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffca9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875178210503680:0@lo:400:kworker.0 00000100:00100000:1.0:1788309481.967215:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788309481.967305:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788309481.967309:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788309481.967337:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210503552 00000100:00100000:1.0:1788309481.967343:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210503552 00000100:00100000:1.0:1788309481.967398:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788309481.967407:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6b4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875178210503552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309481.967452:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6b4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875178210503552:12345-0@lo:400:kworker.0 Request processed in 48us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309481.967459:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:1.0:1788309481.967475:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788309481.967496:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffcaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875178210503552:0@lo:400:kworker.0 00000100:00100000:3.0:1788309481.970700:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309481.970764:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffcaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875178210503808:0@lo:400:kworker.0 00000100:00100000:3.0:1788309481.970811:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309481.976692:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210503808 00000100:00100000:3.0:1788309481.976708:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210503808 00000100:00100000:2.0:1788309481.976757:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210503296 00000100:00100000:2.0:1788309481.976763:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210503296 00000100:00100000:3.0:1788309481.976806:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788309481.976807:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1788309481.976832:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e667c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875178210503808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309481.976837:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:3303:x1875178210503296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309481.976947:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e667c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875178210503808:12345-0@lo:400:kworker.0 Request processed in 128us (6133us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309481.976954:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:3.0:1788309481.976979:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788309481.977112:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:3303:x1875178210503296:12345-0@lo:400:kworker.0 Request processed in 280us (6420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309481.977120:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1788309481.977368:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffcaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875178210503808:0@lo:400:kworker.0 00000100:00100000:2.0:1788309481.977396:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffca9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3303:1875178210503296:0@lo:400:kworker.0 00000001:00100000:0.0:1788309482.067846:0:6706:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ea7f0717-c12d-4408-bdfd-5a035f695b73 00010000:00010000:1.0:1788309482.208798:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788309482.441147:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309482.441197:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309482.441229:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309482.441261:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309482.441314:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192646272 00000100:00100000:0.0:1788309482.441319:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309482.441327:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192646272 00000100:00100000:1.0:1788309482.441390:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192646016 00000100:00100000:1.0:1788309482.441396:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192646016 00000100:00100000:1.0:1788309482.441436:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192645888 00000100:00100000:1.0:1788309482.441439:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192645888 00000100:00100000:3.0:1788309482.441459:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192646144 00000100:00100000:3.0:1788309482.441464:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192646144 00000100:00100000:1.0:1788309482.441473:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 64 00000100:00100000:1.0:1788309482.441486:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc76aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ea7f0717-c12d-4408-bdfd-5a035f695b73+5:2350:x1875178192646016:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788309482.441493:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 35 00000100:00100000:3.0:1788309482.441503:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc76b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ea7f0717-c12d-4408-bdfd-5a035f695b73+5:2350:x1875178192646272:12345-192.168.202.55@tcp:400:kworker.0 00000100:00080000:0.0:1788309482.441596:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788309482.441601:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788309482.441603:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788309482.441629:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc76aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ea7f0717-c12d-4408-bdfd-5a035f695b73+5:2350:x1875178192646016:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 81us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309482.441637:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 64 00000100:00100000:1.0:1788309482.441655:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 65 00000100:00100000:1.0:1788309482.441662:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:2350:x1875178192645888:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:2.0:1788309482.441740:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192645760 00000100:00100000:2.0:1788309482.441745:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192645760 00000100:00100000:2.0:1788309482.441775:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 221 00000100:00100000:2.0:1788309482.441782:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8351692-8d1a-4b41-bdaf-bf179786ff59+13:2350:x1875178192645760:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788309482.448251:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc76b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ea7f0717-c12d-4408-bdfd-5a035f695b73+5:2350:x1875178192646272:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 6735us (7006us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309482.448268:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 35 00000100:00100000:0.0:1788309482.448752:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 36 00000100:00100000:0.0:1788309482.448769:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc768700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ea7f0717-c12d-4408-bdfd-5a035f695b73+5:2350:x1875178192646144:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788309482.448848:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc768700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ea7f0717-c12d-4408-bdfd-5a035f695b73+5:2350:x1875178192646144:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 87us (7531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309482.448855:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 36 00000100:00100000:1.0:1788309482.449148:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:2350:x1875178192645888:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 7483us (7882us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309482.449158:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 65 00000100:00100000:2.0:1788309482.449644:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8351692-8d1a-4b41-bdaf-bf179786ff59+13:2350:x1875178192645760:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 7644us (8289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309482.449653:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 221 00000100:00100000:1.0:1788309482.464753:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8efef9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210504064:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788309482.464846:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309482.465148:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210504064 00000100:00100000:2.0:1788309482.465159:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210504064 00000100:00100000:2.0:1788309482.465227:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788309482.465253:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6b4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875178210504064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788309482.465344:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788309482.465417:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6b4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875178210504064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 165us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309482.465425:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1788309482.465554:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8efef9f80 x1875178210504064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788309498 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788309482.465574:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8efef9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210504064:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788309482.976704:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788309482.976729:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecdc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210504192:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788309482.976820:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309482.977098:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210504192 00000100:00100000:1.0:1788309482.977106:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210504192 00000100:00100000:1.0:1788309482.977177:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788309482.977189:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc76bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210504192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788309482.977229:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788309482.977309:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc76bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210504192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309482.977317:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1788309482.977463:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8ecdc2680 x1875178210504192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788309498 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788309482.977485:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecdc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210504192:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788309483.234066:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788309483.590193:0:10309:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg255-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:1.0:1788309484.257048:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309485.294899:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309486.311940:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788309487.072891:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecdc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3303:1875178210504320:0@lo:400:kworker.0 00000100:00100000:0.0:1788309487.073005:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309487.073122:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210504320 00000100:00100000:3.0:1788309487.073131:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210504320 00000100:00100000:3.0:1788309487.073186:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1788309487.073197:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:3303:x1875178210504320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309487.079169:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:3303:x1875178210504320:12345-0@lo:400:kworker.0 Request processed in 5960us (6161us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309487.079189:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1788309487.079256:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecdc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875178210504704:0@lo:400:kworker.0 00000100:00100000:3.0:1788309487.082188:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309487.082546:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210504704 00000100:00100000:2.0:1788309487.082557:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210504704 00000100:00100000:2.0:1788309487.082628:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788309487.082638:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e667e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875178210504704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309487.082700:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e667e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875178210504704:12345-0@lo:400:kworker.0 Request processed in 64us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309487.082707:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788309487.083126:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecdc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875178210504448:0@lo:400:kworker.0 00000100:00100000:1.0:1788309487.083168:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309487.083192:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788309487.083198:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecdc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875178210504576:0@lo:400:kworker.0 00000100:00100000:1.0:1788309487.083219:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309487.083250:0:8305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210504448 00000100:00100000:1.0:1788309487.083254:0:8305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210504448 00000100:00100000:1.0:1788309487.083326:0:8305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210504576 00000100:00100000:1.0:1788309487.083329:0:8305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210504576 00000100:00100000:1.0:1788309487.083820:0:8305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788309487.083829:0:8305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecdc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875178210504448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309487.083879:0:8305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecdc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875178210504448:12345-0@lo:400:kworker.0 Request processed in 52us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309487.083886:0:8305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788309487.083902:0:8305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788309487.083906:0:8305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecdc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875178210504576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309487.083979:0:8305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecdc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875178210504576:12345-0@lo:400:kworker.0 Request processed in 71us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309487.083985:0:8305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788309487.084155:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecdc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875178210504576:0@lo:400:kworker.0 00000100:00100000:1.0:1788309487.084168:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecdc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875178210504448:0@lo:400:kworker.0 00000100:00100000:1.0:1788309487.084212:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecdc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210504960:0@lo:400:kworker.0 00000100:00100000:1.0:1788309487.084249:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788309487.085308:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788309487.085316:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788309487.085509:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8ecdc2a00 x1875178210504704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788309503 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788309487.085524:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecdc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875178210504704:0@lo:400:kworker.0 00000100:00100000:3.0:1788309487.085546:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788309487.085556:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecdc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875178210504832:0@lo:400:kworker.0 00000100:00100000:3.0:1788309487.085604:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309487.085651:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210504960 00000100:00100000:3.0:1788309487.085657:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210504960 00000100:00100000:3.0:1788309487.085709:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788309487.085718:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6814a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1875178210504960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309487.085762:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6814a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1875178210504960:12345-0@lo:400:kworker.0 Request processed in 46us (1512us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309487.085780:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:3.0:1788309487.085798:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788309487.085926:0:8305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210504832 00000100:00100000:2.0:1788309487.085931:0:8305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210504832 00000100:00100000:2.0:1788309487.085978:0:8305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788309487.085985:0:8305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecdc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875178210504832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309487.086033:0:8305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecdc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875178210504832:12345-0@lo:400:kworker.0 Request processed in 48us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309487.086039:0:8305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:1.0:1788309487.086399:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8ecdc3b80 x1875178210504960/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788309503 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788309487.086407:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecdc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210504960:0@lo:400:kworker.0 00000100:00100000:0.0:1788309487.087159:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecdc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3303:1875178210504320:0@lo:400:kworker.0 00000100:00080000:3.0:1788309487.087197:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788309487.087225:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecdc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875178210504832:0@lo:400:kworker.0 00010000:00010000:0.0:1788309487.337196:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788309487.559427:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309487.559473:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309487.559500:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309487.559521:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309487.559544:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309487.559573:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192646912 00000100:00100000:0.0:1788309487.559584:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192646912 00000100:00100000:0.0:1788309487.559638:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192646784 00000100:00100000:0.0:1788309487.559641:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192646784 00000100:00100000:0.0:1788309487.559661:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 39 00000100:00100000:0.0:1788309487.559671:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc76a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ea7f0717-c12d-4408-bdfd-5a035f695b73+5:2351:x1875178192646912:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788309487.559749:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc76a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ea7f0717-c12d-4408-bdfd-5a035f695b73+5:2351:x1875178192646912:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 78us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309487.559756:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 39 00000100:00100000:0.0:1788309487.559775:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 40 00000100:00100000:0.0:1788309487.559782:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc769880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ea7f0717-c12d-4408-bdfd-5a035f695b73+5:2351:x1875178192646784:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788309487.559823:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc769880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ea7f0717-c12d-4408-bdfd-5a035f695b73+5:2351:x1875178192646784:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 42us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309487.559830:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 40 00000100:00100000:0.0:1788309487.559862:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192646656 00000100:00100000:0.0:1788309487.559866:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192646656 00000100:00100000:0.0:1788309487.559897:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192646528 00000100:00100000:0.0:1788309487.559899:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192646528 00000100:00100000:0.0:1788309487.559920:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 69 00000100:00100000:0.0:1788309487.559926:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ea7f0717-c12d-4408-bdfd-5a035f695b73+5:2351:x1875178192646656:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788309487.559953:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ea7f0717-c12d-4408-bdfd-5a035f695b73+5:2351:x1875178192646656:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 27us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309487.559959:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 69 00000100:00100000:0.0:1788309487.559970:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 70 00000100:00100000:0.0:1788309487.559976:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:2351:x1875178192646528:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788309487.560010:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:2351:x1875178192646528:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 34us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309487.560016:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 70 00000100:00100000:3.0:1788309487.560646:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192646400 00000100:00100000:3.0:1788309487.560655:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192646400 00000100:00100000:3.0:1788309487.560697:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 223 00000100:00100000:3.0:1788309487.560705:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8351692-8d1a-4b41-bdaf-bf179786ff59+13:2351:x1875178192646400:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788309487.560746:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8351692-8d1a-4b41-bdaf-bf179786ff59+13:2351:x1875178192646400:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 42us (1329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309487.560752:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 223 00000100:00080000:3.0:1788309487.560783:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788309487.560789:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788309487.560791:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788309487.585359:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788309487.589068:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8efef8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210505088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788309487.589152:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309487.589515:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210505088 00000100:00100000:1.0:1788309487.589524:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210505088 00000100:00100000:1.0:1788309487.589576:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788309487.589586:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc768a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875178210505088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788309487.589625:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788309487.589687:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc768a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875178210505088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309487.589701:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1788309487.589808:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8efef8700 x1875178210505088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788309503 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788309487.589826:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8efef8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210505088:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788309488.100633:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788309488.100655:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8d6815180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210505216:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788309488.100725:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309488.113195:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210505216 00000100:00100000:0.0:1788309488.113219:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210505216 00000100:00100000:0.0:1788309488.113316:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788309488.113326:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6815f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210505216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788309488.113472:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788309488.113560:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6815f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210505216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 235us (12834us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309488.113565:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:1.0:1788309488.114317:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8d6815180 x1875178210505216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788309504 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788309488.114803:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8d6815180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210505216:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788309488.352575:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309489.377778:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309490.410251:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309491.432942:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788309492.198029:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecdc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3303:1875178210505344:0@lo:400:kworker.0 00000100:00100000:0.0:1788309492.198166:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecdad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875178210505728:0@lo:400:kworker.0 00000100:00100000:3.0:1788309492.198181:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309492.201531:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecdc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875178210505472:0@lo:400:kworker.0 00000100:00100000:0.0:1788309492.201866:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309492.201909:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210505728 00000100:00100000:0.0:1788309492.201917:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210505728 00000100:00100000:0.0:1788309492.201993:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788309492.202003:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc769180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875178210505728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309492.202068:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc769180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875178210505728:12345-0@lo:400:kworker.0 Request processed in 57us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309492.202078:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788309492.202080:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecdac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875178210505856:0@lo:400:kworker.0 00000100:00080000:0.0:1788309492.202100:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788309492.202128:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309492.202174:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecdc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875178210505600:0@lo:400:kworker.0 00000100:00100000:3.0:1788309492.202210:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309492.202247:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210505344 00000100:00100000:3.0:1788309492.202251:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210505344 00000100:00100000:3.0:1788309492.203111:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1788309492.203125:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:3303:x1875178210505344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309492.203201:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:3303:x1875178210505344:12345-0@lo:400:kworker.0 Request processed in 81us (5022us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309492.203208:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1788309492.204232:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210505856 00000100:00100000:3.0:1788309492.204264:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210505856 00000100:00100000:3.0:1788309492.204345:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210505600 00000100:00100000:3.0:1788309492.204349:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210505600 00000100:00100000:3.0:1788309492.204374:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788309492.204384:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecdac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875178210505856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309492.204471:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecdac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875178210505856:12345-0@lo:400:kworker.0 Request processed in 89us (2344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309492.204478:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788309492.204494:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788309492.204500:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecdae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875178210505600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309492.204532:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecdae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875178210505600:12345-0@lo:400:kworker.0 Request processed in 33us (2324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309492.204538:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:3.0:1788309492.204575:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788309492.204615:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecdc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875178210505600:0@lo:400:kworker.0 00010000:00080000:3.0:1788309492.204660:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8ecdad500 x1875178210505728/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788309508 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788309492.204672:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecdad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875178210505728:0@lo:400:kworker.0 00000100:00100000:2.0:1788309492.205880:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecdc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3303:1875178210505344:0@lo:400:kworker.0 00000100:00100000:2.0:1788309492.205901:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecdac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875178210505856:0@lo:400:kworker.0 00000100:00100000:1.0:1788309492.212874:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309492.212935:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecdafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210505984:0@lo:400:kworker.0 00000100:00100000:3.0:1788309492.212944:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210505472 00000100:00100000:3.0:1788309492.212963:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210505472 00000100:00100000:3.0:1788309492.213029:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788309492.213039:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6815180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875178210505472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309492.213103:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309492.213113:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6815180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875178210505472:12345-0@lo:400:kworker.0 Request processed in 74us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309492.213122:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788309492.213136:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210505984 00000100:00100000:1.0:1788309492.213140:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210505984 00000100:00080000:3.0:1788309492.213168:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788309492.213185:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788309492.213193:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc502450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1875178210505984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309492.213241:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc502450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1875178210505984:12345-0@lo:400:kworker.0 Request processed in 50us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309492.213248:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:1.0:1788309492.213603:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8ecdafb80 x1875178210505984/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788309508 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788309492.213617:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecdafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210505984:0@lo:400:kworker.0 00000100:00100000:1.0:1788309492.213644:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecdc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875178210505472:0@lo:400:kworker.0 00010000:00010000:0.0:1788309492.448505:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788309492.689040:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309492.689137:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309492.689174:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309492.689210:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309492.689230:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309492.689259:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192647552 00000100:00100000:0.0:1788309492.689269:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192647552 00000100:00100000:1.0:1788309492.689320:0:8305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192647296 00000100:00100000:1.0:1788309492.689341:0:8305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192647296 00000100:00100000:0.0:1788309492.689362:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192647424 00000100:00100000:0.0:1788309492.689365:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192647424 00000100:00100000:1.0:1788309492.689368:0:8305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192647168 00000100:00100000:1.0:1788309492.689370:0:8305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192647168 00000100:00100000:0.0:1788309492.689384:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 43 00000100:00100000:1.0:1788309492.689391:0:8305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 74 00000100:00100000:1.0:1788309492.689400:0:8305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ea7f0717-c12d-4408-bdfd-5a035f695b73+5:2353:x1875178192647296:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788309492.689401:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc768e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ea7f0717-c12d-4408-bdfd-5a035f695b73+5:2353:x1875178192647552:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788309492.689497:0:8305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ea7f0717-c12d-4408-bdfd-5a035f695b73+5:2353:x1875178192647296:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 87us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309492.689505:0:8305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 74 00000100:00100000:1.0:1788309492.689523:0:8305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 75 00000100:00100000:1.0:1788309492.689530:0:8305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc76b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:2353:x1875178192647168:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788309492.689556:0:8305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc76b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:2353:x1875178192647168:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 27us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309492.689563:0:8305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 75 00000100:00100000:1.0:1788309492.689583:0:6681:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788309492.689592:0:6681:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1788309492.689601:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc768e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ea7f0717-c12d-4408-bdfd-5a035f695b73+5:2353:x1875178192647552:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 202us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309492.689609:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 43 00000100:00100000:0.0:1788309492.689622:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 44 00000100:00100000:0.0:1788309492.689628:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc76ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ea7f0717-c12d-4408-bdfd-5a035f695b73+5:2353:x1875178192647424:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788309492.689651:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc76ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ea7f0717-c12d-4408-bdfd-5a035f695b73+5:2353:x1875178192647424:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 23us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309492.689657:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 44 00000100:00080000:3.0:1788309492.690081:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788309492.690087:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788309492.690089:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788309492.693875:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192647040 00000100:00100000:2.0:1788309492.695021:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192647040 00000100:00100000:0.0:1788309492.695206:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 225 00000100:00100000:0.0:1788309492.695219:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8351692-8d1a-4b41-bdaf-bf179786ff59+13:2353:x1875178192647040:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788309492.695346:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8351692-8d1a-4b41-bdaf-bf179786ff59+13:2353:x1875178192647040:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 130us (6318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309492.695355:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 225 00000100:00100000:1.0:1788309492.705779:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc76a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210506112:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788309492.705860:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309492.705933:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210506112 00000100:00100000:1.0:1788309492.705939:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210506112 00000100:00100000:1.0:1788309492.706007:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788309492.706016:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6814a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875178210506112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788309492.706055:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788309492.706103:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6814a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875178210506112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309492.706110:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1788309492.706149:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8fc76a680 x1875178210506112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788309508 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788309492.706174:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc76a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210506112:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788309493.216920:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788309493.216960:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8d6814e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210506240:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788309493.217051:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309493.217120:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210506240 00000100:00100000:0.0:1788309493.217128:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210506240 00000100:00100000:0.0:1788309493.217177:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788309493.217187:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6817100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210506240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788309493.217225:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788309493.217270:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6817100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210506240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309493.217297:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:1.0:1788309493.217446:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8d6814e00 x1875178210506240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788309509 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788309493.217468:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8d6814e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210506240:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788309493.472447:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309494.496514:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309495.521455:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309496.548037:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788309497.314909:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc76a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875178210506496:0@lo:400:kworker.0 00000100:00100000:2.0:1788309497.315264:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc76b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3303:1875178210506368:0@lo:400:kworker.0 00000100:00100000:2.0:1788309497.315369:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309497.315487:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210506368 00000100:00100000:2.0:1788309497.315495:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210506368 00000100:00100000:2.0:1788309497.315538:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1788309497.315547:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:3303:x1875178210506368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309497.315600:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:3303:x1875178210506368:12345-0@lo:400:kworker.0 Request processed in 54us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309497.315607:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1788309497.315653:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc76b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3303:1875178210506368:0@lo:400:kworker.0 00000100:00100000:2.0:1788309497.317180:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788309497.317206:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8efef9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210506752:0@lo:400:kworker.0 00000100:00100000:2.0:1788309497.317458:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309497.317534:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8efef8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875178210506880:0@lo:400:kworker.0 00000100:00100000:2.0:1788309497.317563:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309497.317649:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210506752 00000100:00100000:3.0:1788309497.317656:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210506752 00000100:00100000:3.0:1788309497.317726:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788309497.317738:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8efefbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210506752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309497.317793:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8efefbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210506752:12345-0@lo:400:kworker.0 Request processed in 59us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309497.317800:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1788309497.317843:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8efef9880 x1875178210506752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788309513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788309497.317858:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8efef9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210506752:0@lo:400:kworker.0 00000100:00080000:2.0:1788309497.320005:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788309497.320485:0:8305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210506880 00000100:00100000:2.0:1788309497.320493:0:8305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210506880 00000100:00100000:2.0:1788309497.320556:0:8305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788309497.320568:0:8305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8efefa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875178210506880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309497.320637:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309497.321421:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210506496 00000100:00100000:1.0:1788309497.321429:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210506496 00000100:00100000:1.0:1788309497.321476:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788309497.321485:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875178210506496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309497.321994:0:8305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8efefa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875178210506880:12345-0@lo:400:kworker.0 Request processed in 1426us (4427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309497.322004:0:8305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788309497.322119:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8efef8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875178210506880:0@lo:400:kworker.0 00000100:00100000:2.0:1788309497.322195:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8efef9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875178210506624:0@lo:400:kworker.0 00000100:00080000:2.0:1788309497.322234:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788309497.322448:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8efef9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210507008:0@lo:400:kworker.0 00000100:00100000:0.0:1788309497.322477:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309497.322548:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210507008 00000100:00100000:3.0:1788309497.322554:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210507008 00000100:00100000:3.0:1788309497.322600:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788309497.322608:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc768700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1875178210507008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309497.322650:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc768700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1875178210507008:12345-0@lo:400:kworker.0 Request processed in 44us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309497.322671:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788309497.322759:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875178210506496:12345-0@lo:400:kworker.0 Request processed in 1275us (2121us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309497.322767:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:0.0:1788309497.323835:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788309497.323872:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8efef9500 x1875178210507008/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788309513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788309497.323885:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8efef9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210507008:0@lo:400:kworker.0 00000100:00100000:0.0:1788309497.323912:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc76a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875178210506496:0@lo:400:kworker.0 00000100:00100000:2.0:1788309497.324541:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309497.324756:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210506624 00000100:00100000:3.0:1788309497.324764:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210506624 00000100:00100000:3.0:1788309497.324828:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788309497.324837:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8efefa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875178210506624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309497.324927:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8efefa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875178210506624:12345-0@lo:400:kworker.0 Request processed in 90us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309497.324936:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788309497.324987:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8efef9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875178210506624:0@lo:400:kworker.0 00000100:00080000:2.0:1788309497.325266:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788309497.570862:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788309497.796172:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309497.796247:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309497.804520:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309497.804563:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192647680 00000100:00100000:0.0:1788309497.804573:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192647680 00000100:00100000:0.0:1788309497.804642:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 227 00000100:00100000:0.0:1788309497.804654:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8351692-8d1a-4b41-bdaf-bf179786ff59+13:2352:x1875178192647680:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788309497.804726:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8351692-8d1a-4b41-bdaf-bf179786ff59+13:2352:x1875178192647680:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 74us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309497.804734:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 227 00000100:00100000:0.0:1788309497.804793:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309497.804930:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309497.804951:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192647936 00000100:00100000:0.0:1788309497.804954:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192647936 00000100:00100000:0.0:1788309497.805010:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192647808 00000100:00100000:0.0:1788309497.805013:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192647808 00000100:00100000:0.0:1788309497.805035:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 79 00000100:00100000:0.0:1788309497.805042:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc76a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ea7f0717-c12d-4408-bdfd-5a035f695b73+5:2352:x1875178192647936:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788309497.805106:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc76a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ea7f0717-c12d-4408-bdfd-5a035f695b73+5:2352:x1875178192647936:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 64us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309497.805114:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 79 00000100:00100000:0.0:1788309497.805127:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 80 00000100:00100000:0.0:1788309497.805134:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:2352:x1875178192647808:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788309497.805156:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:2352:x1875178192647808:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 24us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309497.805162:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 80 00000100:00080000:0.0:1788309497.805181:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788309497.805739:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192648064 00000100:00100000:3.0:1788309497.805747:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192648064 00000100:00100000:3.0:1788309497.805822:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192648192 00000100:00100000:3.0:1788309497.805826:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192648192 00000100:00100000:3.0:1788309497.805856:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 14 00000100:00100000:3.0:1788309497.805864:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc76a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ea7f0717-c12d-4408-bdfd-5a035f695b73+5:2349:x1875178192648064:12345-192.168.202.55@tcp:9:kworker.0 00000020:00000080:3.0:1788309497.805892:0:6681:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x63a04852f46286ee 00000100:00080000:3.0:1788309497.810113:0:6681:0:(import.c:65:import_set_state_nolock()) ffff97c8f52d4800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788309497.810190:0:6681:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1788309497.810614:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc76a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ea7f0717-c12d-4408-bdfd-5a035f695b73+2:2349:x1875178192648064:12345-192.168.202.55@tcp:9:kworker.0 Request processed in 4744us (14449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309497.810626:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 14 00000100:00100000:3.0:1788309497.810663:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 15 00000100:00100000:3.0:1788309497.810677:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc76b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ea7f0717-c12d-4408-bdfd-5a035f695b73+5:2349:x1875178192648192:12345-192.168.202.55@tcp:9:kworker.0 00000020:00000080:3.0:1788309497.810705:0:6681:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x63a04852f46286f5 00000100:00080000:3.0:1788309497.810712:0:6681:0:(import.c:65:import_set_state_nolock()) ffff97c8f52d7000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788309497.810750:0:6681:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1788309497.810986:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc76b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ea7f0717-c12d-4408-bdfd-5a035f695b73+2:2349:x1875178192648192:12345-192.168.202.55@tcp:9:kworker.0 Request processed in 314us (14737us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309497.810993:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 15 00010000:00010000:3.0:1788309497.811024:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788309497.811139:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788309497.811144:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788309497.811171:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788309497.824476:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788309497.824501:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210507136:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788309497.824579:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309497.824645:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210507136 00000100:00100000:0.0:1788309497.824652:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210507136 00000100:00100000:0.0:1788309497.824698:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788309497.824709:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc76b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875178210507136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788309497.824744:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788309497.824789:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc76b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875178210507136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309497.824797:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1788309497.824838:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8fc769180 x1875178210507136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788309513 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788309497.824857:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210507136:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788309498.336494:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788309498.336518:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8d6814e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210507264:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788309498.336592:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309498.336711:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210507264 00000100:00100000:0.0:1788309498.336718:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210507264 00000100:00100000:0.0:1788309498.336776:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788309498.336787:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8efefad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210507264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788309498.336819:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788309498.336873:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8efefad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210507264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309498.336879:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:2.0:1788309498.336968:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8d6814e00 x1875178210507264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788309514 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788309498.336990:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8d6814e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210507264:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788309498.598185:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309499.620477:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309500.640563:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788309501.478648:0:7639:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ea7f0717-c12d-4408-bdfd-5a035f695b73 00000020:00000080:0.0:1788309501.478656:0:7639:0:(genops.c:885:class_export_put()) final put ffff97c8f52d1800/ea7f0717-c12d-4408-bdfd-5a035f695b73 00000020:00000080:2.0:1788309501.478726:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff97c8f52d1800/ea7f0717-c12d-4408-bdfd-5a035f695b73 for lustre-OST0001 00000020:00000080:2.0:1788309501.478950:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97c8f52d7000 for lustre-OST0001 00010000:00010000:3.0:1788309501.674331:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788309501.850869:0:11012:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1788309502.435555:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3303:1875178210507392:0@lo:400:kworker.0 00000100:00100000:0.0:1788309502.435635:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309502.435689:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffcaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875178210507904:0@lo:400:kworker.0 00000100:00100000:0.0:1788309502.435719:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309502.435747:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788309502.435752:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffcabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210507776:0@lo:400:kworker.0 00000100:00100000:0.0:1788309502.435780:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309502.435811:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffca8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875178210507520:0@lo:400:kworker.0 00000100:00100000:0.0:1788309502.435837:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309502.435852:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffca9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210508032:0@lo:400:kworker.0 00000100:00100000:0.0:1788309502.435884:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309502.435903:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788309502.435909:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffcab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875178210507648:0@lo:400:kworker.0 00000100:00100000:0.0:1788309502.435929:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309502.435966:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210507392 00000100:00100000:0.0:1788309502.435988:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210507392 00000100:00100000:0.0:1788309502.436045:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1788309502.436054:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:3303:x1875178210507392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309502.436107:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:3303:x1875178210507392:12345-0@lo:400:kworker.0 Request processed in 53us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309502.436116:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1788309502.436150:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210507904 00000100:00100000:0.0:1788309502.436154:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210507904 00000100:00100000:0.0:1788309502.436188:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210507520 00000100:00100000:0.0:1788309502.436191:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210507520 00000100:00100000:0.0:1788309502.436204:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210507648 00000100:00100000:0.0:1788309502.436219:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210507648 00000100:00100000:0.0:1788309502.436236:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788309502.436241:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffca8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875178210507904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309502.436272:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffca8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875178210507904:12345-0@lo:400:kworker.0 Request processed in 30us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309502.436315:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788309502.436329:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788309502.436336:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffcaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875178210507520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309502.436367:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffcaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875178210507520:12345-0@lo:400:kworker.0 Request processed in 32us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309502.436374:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788309502.436385:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788309502.436390:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffca9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875178210507648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309502.436414:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffca9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875178210507648:12345-0@lo:400:kworker.0 Request processed in 25us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309502.436421:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788309502.436448:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210507776 00000100:00100000:0.0:1788309502.436452:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210507776 00000100:00100000:0.0:1788309502.436477:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210508032 00000100:00100000:0.0:1788309502.436480:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210508032 00000100:00100000:0.0:1788309502.436497:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788309502.436503:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffca9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210507776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309502.436534:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffca9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210507776:12345-0@lo:400:kworker.0 Request processed in 31us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309502.436539:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788309502.436550:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788309502.436556:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffcaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1875178210508032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309502.436580:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffcaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1875178210508032:12345-0@lo:400:kworker.0 Request processed in 25us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309502.436586:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:0.0:1788309502.436615:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788309502.436619:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788309502.436621:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788309502.436654:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffcab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875178210507648:0@lo:400:kworker.0 00000100:00100000:0.0:1788309502.436663:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffca8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875178210507520:0@lo:400:kworker.0 00010000:00080000:0.0:1788309502.436673:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8ffca9880 x1875178210508032/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788309518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788309502.436683:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffca9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210508032:0@lo:400:kworker.0 00010000:00080000:0.0:1788309502.436712:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8ffcabb80 x1875178210507776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788309518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788309502.436720:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffcabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210507776:0@lo:400:kworker.0 00000100:00100000:0.0:1788309502.436737:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3303:1875178210507392:0@lo:400:kworker.0 00000100:00100000:0.0:1788309502.436746:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffcaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875178210507904:0@lo:400:kworker.0 00010000:00010000:1.0:1788309502.690511:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788309502.701209:0:6706:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ea7f0717-c12d-4408-bdfd-5a035f695b73 00000020:00000080:0.0:1788309502.701221:0:6706:0:(genops.c:885:class_export_put()) final put ffff97c8f52d6800/ea7f0717-c12d-4408-bdfd-5a035f695b73 00000020:00000080:1.0:1788309502.701345:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97c8f52d6800/ea7f0717-c12d-4408-bdfd-5a035f695b73 for lustre-OST0000 00000020:00000080:1.0:1788309502.701406:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97c8f52d4800 for lustre-OST0000 00000100:00100000:0.0:1788309502.926082:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309502.926128:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309502.926165:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309502.926305:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192648576 00000100:00100000:1.0:1788309502.926316:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192648576 00000100:00100000:1.0:1788309502.926395:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192648448 00000100:00100000:1.0:1788309502.926398:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192648448 00000100:00100000:1.0:1788309502.926424:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 84 00000100:00100000:1.0:1788309502.926435:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffcaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ea7f0717-c12d-4408-bdfd-5a035f695b73+5:2350:x1875178192648576:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788309502.926523:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffcaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ea7f0717-c12d-4408-bdfd-5a035f695b73+5:2350:x1875178192648576:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 89us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309502.926531:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 84 00000100:00100000:1.0:1788309502.926549:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 85 00000100:00100000:1.0:1788309502.926556:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffcabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:2350:x1875178192648448:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788309502.926580:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffcabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:2350:x1875178192648448:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 25us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309502.926585:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 85 00000100:00080000:0.0:1788309502.926781:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788309502.927071:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192648320 00000100:00100000:2.0:1788309502.927076:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192648320 00000100:00100000:2.0:1788309502.927115:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 229 00000100:00100000:2.0:1788309502.927122:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8351692-8d1a-4b41-bdaf-bf179786ff59+13:2350:x1875178192648320:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:2.0:1788309502.927169:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8351692-8d1a-4b41-bdaf-bf179786ff59+13:2350:x1875178192648320:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 47us (1098us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309502.927176:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 229 00000100:00100000:3.0:1788309502.949463:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788309502.949492:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffca9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210508160:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788309502.949575:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309502.949889:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210508160 00000100:00100000:0.0:1788309502.949897:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210508160 00000100:00100000:0.0:1788309502.949951:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788309502.949960:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecdad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875178210508160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788309502.949993:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788309502.950051:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecdad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875178210508160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309502.950059:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1788309502.950351:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8ffca9880 x1875178210508160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788309518 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788309502.950379:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffca9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210508160:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788309503.456638:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecdadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875178210508288:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788309503.456714:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309503.456820:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210508288 00000100:00100000:3.0:1788309503.456828:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210508288 00000100:00100000:3.0:1788309503.456896:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788309503.456907:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffca8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875178210508288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788309503.456947:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1788309503.456999:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffca8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875178210508288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309503.457008:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:3.0:1788309503.457049:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8ecdadc00 x1875178210508288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788309519 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788309503.457069:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecdadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875178210508288:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788309503.713301:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309504.751621:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309505.764663:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788309505.882902:0:11160:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc20995a90 20000000:00000080:1.0:1788309505.882921:0:11160:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff97c8e6b4ac00 uarg=0000000000000000 20000000:01000000:1.0:1788309505.883089:0:11160:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788309505.883096:0:11160:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788309505.883101:0:11160:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788309505.884350:0:11161:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1788309505.884839:0:11160:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788309505.893192:0:11160:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788309505.897085:0:11160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97c8d73ef200/0x63a04852f46286fc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309505.897112:0:11160:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c8f5548a00/0x63a04852f46286a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f46286a1 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309505.897120:0:11160:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c8d73ef000/0x63a04852f46286b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f46286af expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309505.897138:0:11160:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c8d73ee400/0x63a04852f46286c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f46286bd expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309505.897151:0:11160:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c8c153bc00/0x63a04852f46286cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a913 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309505.897158:0:11160:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c8f5549e00/0x63a04852f46286e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a94b expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309505.897166:0:11160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97c8d73ef200/0x63a04852f46286fc lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309505.897211:0:11160:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c8f5549e00/0x63a04852f46286e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a94b expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309505.897228:0:11160:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97c8f5549e00/0x63a04852f46286e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a94b expref: 12 pid: 5830 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309505.897243:0:11160:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffcab800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11160:1875178210508416:192.168.202.55@tcp:104: 00010000:00010000:0.0:1788309505.897787:0:11160:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c8c153bc00/0x63a04852f46286cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a913 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309505.897798:0:11160:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97c8c153bc00/0x63a04852f46286cb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a913 expref: 12 pid: 5831 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309505.897808:0:11160:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffcab100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11160:1875178210508544:192.168.202.55@tcp:104: 00010000:00010000:0.0:1788309505.897854:0:11160:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c8d73ee400/0x63a04852f46286c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x63a04852f46286bd expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309505.897876:0:11160:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97c8d73ee400/0x63a04852f46286c4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x63a04852f46286bd expref: 18 pid: 5830 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309505.897887:0:11160:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffca8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11160:1875178210508672:0@lo:104: 00000100:00100000:0.0:1788309505.897932:0:11160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788309505.897984:0:11160:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c8d73ef000/0x63a04852f46286b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x63a04852f46286af expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309505.897993:0:11160:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97c8d73ef000/0x63a04852f46286b6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x63a04852f46286af expref: 18 pid: 5832 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309505.898002:0:11160:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc769180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11160:1875178210508800:0@lo:104: 00000100:00100000:3.0:1788309505.898089:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210508672 00000100:00100000:3.0:1788309505.898098:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210508672 00000100:00100000:3.0:1788309505.898212:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788309505.898223:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffca9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+3:11160:x1875178210508672:12345-0@lo:104: 00010000:00010000:3.0:1788309505.898236:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff97c8c153ac00/0x63a04852f46286bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x63a04852f46286c4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309505.898302:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788309505.898308:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffca9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+3:11160:x1875178210508672:12345-0@lo:104: Request processed in 88us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309505.898314:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788309505.898639:0:11160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309505.910435:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309505.911123:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309505.911218:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192648704 00000100:00100000:1.0:1788309505.911229:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192648704 00010000:00010000:1.0:1788309505.911272:0:8447:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c8f5549e00/0x63a04852f46286e0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a94b expref: 13 pid: 5830 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309505.911332:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192648832 00000100:00100000:1.0:1788309505.911335:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192648832 00010000:00010000:1.0:1788309505.911348:0:8447:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c8c153bc00/0x63a04852f46286cb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a913 expref: 14 pid: 5831 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309505.911399:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 25 00000100:00100000:1.0:1788309505.911410:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6b2a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f8351692-8d1a-4b41-bdaf-bf179786ff59+14:2351:x1875178192648704:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788309505.911423:0:8447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788309505.911430:0:8447:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c8f5549e00/0x63a04852f46286e0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a94b expref: 14 pid: 5830 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309505.911443:0:8447:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c8f5549e00/0x63a04852f46286e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a94b expref: 14 pid: 5830 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309505.911463:0:8447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788309505.911529:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6b2a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f8351692-8d1a-4b41-bdaf-bf179786ff59+14:2351:x1875178192648704:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 120us (1104us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309505.911537:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 25 00000100:00100000:1.0:1788309505.912263:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 26 00000100:00100000:1.0:1788309505.912273:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6816d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f8351692-8d1a-4b41-bdaf-bf179786ff59+13:2351:x1875178192648832:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788309505.912311:0:8447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788309505.912317:0:8447:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c8c153bc00/0x63a04852f46286cb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a913 expref: 13 pid: 5831 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309505.912328:0:8447:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c8c153bc00/0x63a04852f46286cb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a913 expref: 13 pid: 5831 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309505.912339:0:8447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788309505.912366:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6816d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f8351692-8d1a-4b41-bdaf-bf179786ff59+13:2351:x1875178192648832:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 95us (1246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309505.912372:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 26 00010000:00010000:1.0:1788309505.913445:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788309505.913455:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff97c8c153ac00/0x63a04852f46286bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x63a04852f46286c4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309505.913467:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8c153ac00 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:1.0:1788309505.913472:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff97c8c153ac00/0x63a04852f46286bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x63a04852f46286c4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309505.913482:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff97c8c153ac00/0x63a04852f46286bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x63a04852f46286c4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788309505.913830:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff97c8c153ac00/0x63a04852f46286bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x63a04852f46286c4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788309505.913839:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788309505.913890:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff97c8c153ac00/0x63a04852f46286bd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f46286c4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309505.913896:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788309505.913925:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff97c8c153ac00/0x63a04852f46286bd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f46286c4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309505.913933:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff97c8c153ac00/0x63a04852f46286bd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f46286c4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309505.915071:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309505.915074:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309505.915077:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788309505.915103:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8d6816680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3303:1875178210508928:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788309505.915337:0:11160:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c8f5548a00/0x63a04852f46286a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x63a04852f46286a1 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309505.915351:0:11160:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97c8f5548a00/0x63a04852f46286a8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x63a04852f46286a1 expref: 18 pid: 5830 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309505.915363:0:11160:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11160:1875178210509056:0@lo:104: 00000100:00100000:0.0:1788309505.915400:0:11160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309505.915634:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309505.915862:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210508928 00000100:00100000:2.0:1788309505.915863:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210508800 00000100:00100000:2.0:1788309505.915870:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210508800 00000100:00100000:1.0:1788309505.915870:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210508928 00010000:00010000:1.0:1788309505.915899:0:8447:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c8d73ee400/0x63a04852f46286c4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63a04852f46286bd expref: 19 pid: 5830 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309505.915908:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788309505.915917:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8eff0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+3:11160:x1875178210508800:12345-0@lo:104: 00000100:00100000:1.0:1788309505.915919:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788309505.915924:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6817480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:3303:x1875178210508928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788309505.915928:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8c00/0x63a04852f46286af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x63a04852f46286b6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309505.915946:0:8447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788309505.915952:0:8447:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c8d73ee400/0x63a04852f46286c4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63a04852f46286bd expref: 19 pid: 5830 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309505.915962:0:8447:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c8d73ee400/0x63a04852f46286c4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x63a04852f46286bd expref: 19 pid: 5830 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309505.915979:0:8447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788309505.916022:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6817480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:3303:x1875178210508928:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309505.916029:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788309505.916069:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8d6816680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3303:1875178210508928:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788309505.916173:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788309505.916180:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8eff0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+3:11160:x1875178210508800:12345-0@lo:104: Request processed in 264us (17541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309505.916195:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:1.0:1788309505.916254:0:7628:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788309505.916260:0:7628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8c00/0x63a04852f46286af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x63a04852f46286b6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309505.916268:0:7628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d8c00 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:1.0:1788309505.916272:0:7628:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8c00/0x63a04852f46286af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x63a04852f46286b6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309505.916307:0:7628:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8c00/0x63a04852f46286af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x63a04852f46286b6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788309505.916325:0:7628:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8c00/0x63a04852f46286af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x63a04852f46286b6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788309505.916331:0:7628:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788309505.916361:0:7628:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8c00/0x63a04852f46286af lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f46286b6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309505.916368:0:7628:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788309505.916400:0:7628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8c00/0x63a04852f46286af lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f46286b6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309505.916408:0:7628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8c00/0x63a04852f46286af lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f46286b6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309505.916421:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309505.916423:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309505.916425:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788309505.916431:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788309505.916440:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8d6816680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3301:1875178210509184:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788309505.916468:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309505.916509:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210509184 00000100:00100000:1.0:1788309505.916513:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210509184 00010000:00010000:1.0:1788309505.916527:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c8d73ef000/0x63a04852f46286b6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63a04852f46286af expref: 19 pid: 5832 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309505.916546:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788309505.916562:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6814380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:3301:x1875178210509184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788309505.916570:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788309505.916580:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c8d73ef000/0x63a04852f46286b6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63a04852f46286af expref: 19 pid: 5832 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309505.916590:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c8d73ef000/0x63a04852f46286b6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x63a04852f46286af expref: 19 pid: 5832 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309505.916601:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788309505.916637:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6814380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:3301:x1875178210509184:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309505.916652:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8d6816680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3301:1875178210509184:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788309505.916815:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788309505.917472:0:11160:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8ea1c8a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788309505.917589:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210509056 00000100:00100000:3.0:1788309505.917595:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210509056 00010000:00010000:0.0:1788309505.917614:0:11160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c8f5549e00/0x63a04852f46286e0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a94b expref: 12 pid: 5830 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309505.917629:0:11160:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffcab800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11160:1875178210508416:192.168.202.55@tcp:104: 00000100:00100000:3.0:1788309505.917633:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788309505.917640:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8eff0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+3:11160:x1875178210509056:12345-0@lo:104: 00010000:00010000:3.0:1788309505.917651:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8600/0x63a04852f46286a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x63a04852f46286a8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309505.917707:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788309505.917713:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8eff0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+3:11160:x1875178210509056:12345-0@lo:104: Request processed in 74us (2313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309505.917719:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1788309505.917723:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788309505.917728:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8600/0x63a04852f46286a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x63a04852f46286a8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309505.917734:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d8600 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:1.0:1788309505.917738:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8600/0x63a04852f46286a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x63a04852f46286a8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309505.917819:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8600/0x63a04852f46286a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x63a04852f46286a8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788309505.917837:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8600/0x63a04852f46286a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x63a04852f46286a8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788309505.917842:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788309505.917874:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8600/0x63a04852f46286a1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f46286a8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309505.917881:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788309505.917904:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8600/0x63a04852f46286a1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f46286a8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309505.917926:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8600/0x63a04852f46286a1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f46286a8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309505.917933:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788309505.917951:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8d6816a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3300:1875178210509312:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788309505.917951:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309505.917953:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309505.917955:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788309505.917984:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309505.918104:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210509312 00000100:00100000:1.0:1788309505.918108:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210509312 00010000:00010000:1.0:1788309505.918126:0:8447:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c8f5548a00/0x63a04852f46286a8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63a04852f46286a1 expref: 19 pid: 5830 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309505.918157:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788309505.918164:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecdadc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:3300:x1875178210509312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788309505.918186:0:8447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788309505.918191:0:8447:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c8f5548a00/0x63a04852f46286a8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63a04852f46286a1 expref: 19 pid: 5830 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309505.918202:0:8447:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c8f5548a00/0x63a04852f46286a8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x63a04852f46286a1 expref: 19 pid: 5830 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309505.918218:0:8447:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97c8d73ef200/0x63a04852f46286fc lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309505.918227:0:8447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8d73ef200/0x63a04852f46286fc lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309505.918242:0:8447:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97c8d73ef200/0x63a04852f46286fc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309505.918260:0:8447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97c8d73ef200/0x63a04852f46286fc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309505.918267:0:8447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97c8d73ef200/0x63a04852f46286fc lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309505.918273:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97c8d73ef200/0x63a04852f46286fc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309505.918305:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8d73ef200 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:1.0:1788309505.918310:0:8447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97c8d73ef200/0x63a04852f46286fc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309505.918317:0:8447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97c8d73ef200/0x63a04852f46286fc lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309505.918326:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97c8d73ef200/0x63a04852f46286fc lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309505.918336:0:8447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788309505.918373:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecdadc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:3300:x1875178210509312:12345-0@lo:103:ldlm_bl.0 Request processed in 210us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309505.918590:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8d6816a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3300:1875178210509312:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788309505.918620:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:0.0:1788309505.918739:0:11160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c8c153bc00/0x63a04852f46286cb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a913 expref: 11 pid: 5831 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309505.918843:0:11160:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffcab100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11160:1875178210508544:192.168.202.55@tcp:104: 00010000:00010000:0.0:1788309505.918860:0:11160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c8d73ee400/0x63a04852f46286c4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x63a04852f46286bd expref: 18 pid: 5830 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309505.918869:0:11160:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffca8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11160:1875178210508672:0@lo:104: 00010000:00010000:0.0:1788309505.918879:0:11160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c8d73ef000/0x63a04852f46286b6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x63a04852f46286af expref: 17 pid: 5832 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309505.918888:0:11160:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc769180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11160:1875178210508800:0@lo:104: 00010000:00010000:0.0:1788309505.918896:0:11160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c8f5548a00/0x63a04852f46286a8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x63a04852f46286a1 expref: 16 pid: 5830 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309505.918905:0:11160:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11160:1875178210509056:0@lo:104: 00010000:00010000:0.0:1788309505.918926:0:11160:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97c8d73ef200/0x63a04852f46286fc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309505.919058:0:11160:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97c8d73ef200/0x63a04852f46286fc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309505.919067:0:11160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97c8d73ef200/0x63a04852f46286fc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309505.919073:0:11160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c8d73ef200/0x63a04852f46286fc lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309506.791417:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788309506.955406:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309506.962038:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192648960 00000100:00100000:3.0:1788309506.962054:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192648960 00000100:00100000:3.0:1788309506.962138:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 230 00000100:00100000:3.0:1788309506.962152:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8351692-8d1a-4b41-bdaf-bf179786ff59+11:5592:x1875178192648960:12345-192.168.202.55@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788309506.962383:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309506.962409:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c8c153a200/0x63a04852f4628703 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8a28c761146a975 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309506.962439:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8c153a200/0x63a04852f4628703 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a975 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309506.962450:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c8c153a200/0x63a04852f4628703 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a975 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309506.962460:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8c153a200, rc 0) 00000100:00100000:3.0:1788309506.963699:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8351692-8d1a-4b41-bdaf-bf179786ff59+12:5592:x1875178192648960:12345-192.168.202.55@tcp:101:ll_cfg_requeue.0 Request processed in 1541us (8294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309506.963711:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 230 00000100:00100000:3.0:1788309506.984987:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309506.985137:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192649088 00000100:00100000:0.0:1788309506.985149:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192649088 00000100:00100000:0.0:1788309506.985220:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 231 00000100:00100000:0.0:1788309506.985251:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6a6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8351692-8d1a-4b41-bdaf-bf179786ff59+12:5592:x1875178192649088:12345-192.168.202.55@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788309506.985588:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6a6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8351692-8d1a-4b41-bdaf-bf179786ff59+12:5592:x1875178192649088:12345-192.168.202.55@tcp:501:ll_cfg_requeue.0 Request processed in 339us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309506.985598:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 231 00000100:00100000:0.0:1788309506.990833:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309507.000746:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192649216 00000100:00100000:3.0:1788309507.000764:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192649216 00000100:00100000:3.0:1788309507.000856:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 232 00000100:00100000:3.0:1788309507.000868:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6a6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8351692-8d1a-4b41-bdaf-bf179786ff59+12:5592:x1875178192649216:12345-192.168.202.55@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788309507.001135:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6a6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8351692-8d1a-4b41-bdaf-bf179786ff59+12:5592:x1875178192649216:12345-192.168.202.55@tcp:503:ll_cfg_requeue.0 Request processed in 268us (10323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309507.001145:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 232 00000100:00100000:2.0:1788309507.034498:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309507.034541:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192649344 00000100:00100000:2.0:1788309507.034551:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192649344 00000100:00100000:2.0:1788309507.034603:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 233 00000100:00100000:2.0:1788309507.034614:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6a6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8351692-8d1a-4b41-bdaf-bf179786ff59+12:5592:x1875178192649344:12345-192.168.202.55@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788309507.034633:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309507.034651:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c8e26d8a00/0x63a04852f462870a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8a28c761146a97c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309507.034682:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8e26d8a00/0x63a04852f462870a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a97c expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309507.034694:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c8e26d8a00/0x63a04852f462870a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a97c expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309507.034704:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8e26d8a00, rc 0) 00000100:00100000:2.0:1788309507.034757:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6a6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8351692-8d1a-4b41-bdaf-bf179786ff59+13:5592:x1875178192649344:12345-192.168.202.55@tcp:101:ll_cfg_requeue.0 Request processed in 144us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309507.034763:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 233 00000100:00100000:1.0:1788309507.039726:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309507.040821:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192649472 00000100:00100000:3.0:1788309507.040835:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192649472 00000100:00100000:3.0:1788309507.040896:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 234 00000100:00100000:3.0:1788309507.040906:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6a6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8351692-8d1a-4b41-bdaf-bf179786ff59+13:5592:x1875178192649472:12345-192.168.202.55@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788309507.041250:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6a6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8351692-8d1a-4b41-bdaf-bf179786ff59+13:5592:x1875178192649472:12345-192.168.202.55@tcp:501:ll_cfg_requeue.0 Request processed in 344us (1535us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309507.041260:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 234 00000100:00100000:2.0:1788309507.054588:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309507.054839:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192649600 00000100:00100000:1.0:1788309507.054854:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192649600 00000100:00100000:1.0:1788309507.054933:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 235 00000100:00100000:1.0:1788309507.054949:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6a6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8351692-8d1a-4b41-bdaf-bf179786ff59+13:5592:x1875178192649600:12345-192.168.202.55@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788309507.055234:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6a6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8351692-8d1a-4b41-bdaf-bf179786ff59+13:5592:x1875178192649600:12345-192.168.202.55@tcp:503:ll_cfg_requeue.0 Request processed in 288us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309507.055250:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 235 10000000:01000000:2.0:1788309507.489033:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788309507.489043:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97c8f519c800 from 7 10000000:01000000:2.0:1788309507.489051:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788309507.489112:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8000/0x63a04852f4628711 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309507.489138:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8000/0x63a04852f4628711 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309507.489151:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8000/0x63a04852f4628711 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309507.489179:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8efef9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210509440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788309507.489262:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309507.489351:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d6aee180 going to sleep for 11 seconds 00000100:00100000:3.0:1788309507.489473:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210509440 00000100:00100000:3.0:1788309507.489482:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210509440 00000100:00100000:3.0:1788309507.489541:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788309507.489551:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6a6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+16:5834:x1875178210509440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788309507.489564:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309507.489576:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c8c153a000/0x63a04852f4628718 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x63a04852f4628711 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309507.489599:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8c153a000/0x63a04852f4628718 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63a04852f4628711 expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309507.489610:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c8c153a000/0x63a04852f4628718 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f4628711 expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309507.489620:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8c153a000, rc 0) 00000100:00100000:3.0:1788309507.489664:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6a6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+17:5834:x1875178210509440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309507.489671:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1788309507.489954:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8efef9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210509440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788309507.489971:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8000/0x63a04852f4628711 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4628718 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309507.489980:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8000/0x63a04852f4628711 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x63a04852f4628718 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309507.490045:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210509568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788309507.490076:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309507.490110:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d3a5ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1788309507.490167:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210509568 00000100:00100000:2.0:1788309507.490172:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210509568 00000100:00100000:2.0:1788309507.490206:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1788309507.490213:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6a6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+17:5834:x1875178210509568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788309507.490485:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6a6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+17:5834:x1875178210509568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 272us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309507.490491:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1788309507.490523:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210509568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788309507.490555:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8efef9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210509696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788309507.490592:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309507.490607:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d6aeeb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788309507.490619:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210509696 00000100:00100000:2.0:1788309507.490623:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210509696 00000100:00100000:2.0:1788309507.490639:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1788309507.490645:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6a6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+17:5834:x1875178210509696:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788309507.490785:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6a6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+17:5834:x1875178210509696:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 138us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309507.490799:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1788309507.490848:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8efef9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210509696:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788309507.493152:0:11194:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788309507.493545:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788309507.493569:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788309507.493580:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8000/0x63a04852f4628711 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4628718 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309507.493592:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8000/0x63a04852f4628711 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4628718 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788309507.493603:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788309507.493606:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97c8d6805000 from 7 10000000:01000000:2.0:1788309507.493609:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788309507.493642:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8e00/0x63a04852f462871f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309507.493651:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8e00/0x63a04852f462871f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309507.493662:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8e00/0x63a04852f462871f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309507.493686:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8efef9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210509824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788309507.493765:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309507.493824:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d6aeeb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788309507.495890:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210509824 00000100:00100000:3.0:1788309507.495903:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210509824 00000100:00100000:3.0:1788309507.495978:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788309507.495990:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6a6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+17:5834:x1875178210509824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788309507.496008:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309507.496026:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c8c153ac00/0x63a04852f4628726 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x63a04852f462871f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309507.496052:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8c153ac00/0x63a04852f4628726 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63a04852f462871f expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309507.496062:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c8c153ac00/0x63a04852f4628726 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f462871f expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309507.496071:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8c153ac00, rc 0) 00000100:00100000:3.0:1788309507.496139:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6a6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+18:5834:x1875178210509824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (2374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309507.496147:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1788309507.496392:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8efef9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210509824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788309507.496410:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8e00/0x63a04852f462871f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4628726 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309507.496431:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8e00/0x63a04852f462871f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x63a04852f4628726 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309507.496497:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8efef9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210509952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788309507.496530:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309507.496564:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d6aeeb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788309507.498944:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210509952 00000100:00100000:3.0:1788309507.498957:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210509952 00000100:00100000:3.0:1788309507.499126:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1788309507.499139:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6a6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+18:5834:x1875178210509952:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788309507.499493:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6a6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+18:5834:x1875178210509952:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 356us (2961us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309507.499502:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1788309507.499638:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8efef9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210509952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788309507.499686:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8d6817800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210510080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788309507.499731:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309507.499761:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8ffc8b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788309507.499776:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210510080 00000100:00100000:1.0:1788309507.499780:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210510080 00000100:00100000:1.0:1788309507.499821:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1788309507.499829:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6a6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+18:5834:x1875178210510080:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788309507.499977:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6a6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+18:5834:x1875178210510080:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 149us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309507.499984:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1788309507.500022:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8d6817800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210510080:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788309507.500726:0:11196:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788309507.500784:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788309507.500801:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788309507.500826:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8e00/0x63a04852f462871f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4628726 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309507.500837:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8e00/0x63a04852f462871f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4628726 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788309507.500847:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788309507.500850:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97c8e07b1000 from 7 10000000:01000000:1.0:1788309507.500853:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788309507.500880:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8f5549200/0x63a04852f462872d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309507.500893:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff97c8f5549200/0x63a04852f462872d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309507.500903:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff97c8f5549200/0x63a04852f462872d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309507.500921:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8d6817800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210510208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788309507.500960:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309507.500978:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8ffc8bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788309507.500992:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210510208 00000100:00100000:1.0:1788309507.500996:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210510208 00000100:00100000:1.0:1788309507.501018:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1788309507.501024:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6a6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+18:5834:x1875178210510208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788309507.501034:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788309507.501045:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c8f5548400/0x63a04852f4628734 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x63a04852f462872d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309507.501066:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8f5548400/0x63a04852f4628734 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63a04852f462872d expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309507.501078:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c8f5548400/0x63a04852f4628734 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f462872d expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309507.501086:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8f5548400, rc 0) 00000100:00100000:1.0:1788309507.501117:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6a6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:5834:x1875178210510208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309507.501122:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1788309507.501162:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8d6817800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210510208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788309507.501176:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff97c8f5549200/0x63a04852f462872d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4628734 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309507.501185:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff97c8f5549200/0x63a04852f462872d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x63a04852f4628734 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309507.501230:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8d6817800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210510336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788309507.501255:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309507.501266:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8ffc8bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788309507.501301:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210510336 00000100:00100000:1.0:1788309507.501304:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210510336 00000100:00100000:1.0:1788309507.501320:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788309507.501325:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6a6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:5834:x1875178210510336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788309507.501541:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6a6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:5834:x1875178210510336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 214us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309507.501548:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788309507.501578:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8d6817800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210510336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788309507.501602:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8d6817800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210510464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788309507.501635:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309507.501647:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8ffc8bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788309507.501659:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210510464 00000100:00100000:1.0:1788309507.501662:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210510464 00000100:00100000:1.0:1788309507.501678:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1788309507.501684:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6a6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:5834:x1875178210510464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788309507.501800:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6a6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:5834:x1875178210510464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 116us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309507.501824:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1788309507.501854:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8d6817800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210510464:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788309507.502618:0:11197:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788309507.502666:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788309507.502683:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788309507.502694:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8f5549200/0x63a04852f462872d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4628734 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309507.502704:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff97c8f5549200/0x63a04852f462872d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4628734 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309507.556066:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8efef9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875178210510720:0@lo:400:kworker.0 00000100:00100000:1.0:1788309507.556622:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309507.556667:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788309507.556675:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8efef8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875178210510592:0@lo:400:kworker.0 00000100:00100000:1.0:1788309507.556702:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309507.556720:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8efef8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210511104:0@lo:400:kworker.0 00000100:00100000:1.0:1788309507.556743:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309507.556773:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210510720 00000100:00100000:1.0:1788309507.556780:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210510720 00000100:00100000:1.0:1788309507.556841:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210510592 00000100:00100000:1.0:1788309507.556845:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210510592 00000100:00100000:1.0:1788309507.556866:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788309507.556875:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6817800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875178210510720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309507.556928:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6817800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875178210510720:12345-0@lo:400:kworker.0 Request processed in 53us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309507.556944:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788309507.556962:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788309507.556967:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6815500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875178210510592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309507.556995:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6815500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875178210510592:12345-0@lo:400:kworker.0 Request processed in 28us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309507.557000:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788309507.557021:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210511104 00000100:00100000:1.0:1788309507.557024:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210511104 00000100:00100000:1.0:1788309507.557050:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788309507.557056:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6814700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210511104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309507.557083:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6814700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210511104:12345-0@lo:400:kworker.0 Request processed in 28us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309507.557088:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:1.0:1788309507.557102:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788309507.557105:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788309507.557139:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8efef8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875178210510592:0@lo:400:kworker.0 00010000:00080000:1.0:1788309507.557152:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8efef8700 x1875178210511104/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788309523 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788309507.557223:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8efef8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210511104:0@lo:400:kworker.0 00000100:00100000:1.0:1788309507.557237:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8efef9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875178210510720:0@lo:400:kworker.0 00000100:00100000:3.0:1788309507.557440:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8efefaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210510848:0@lo:400:kworker.0 00000100:00100000:3.0:1788309507.557473:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309507.557540:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788309507.557547:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8efefb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875178210510976:0@lo:400:kworker.0 00000100:00100000:3.0:1788309507.557571:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309507.557857:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210510848 00000100:00100000:2.0:1788309507.557863:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210510848 00000100:00100000:1.0:1788309507.557926:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210510976 00000100:00100000:1.0:1788309507.557930:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210510976 00000100:00100000:2.0:1788309507.557934:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788309507.557941:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecdad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1875178210510848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309507.557984:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecdad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1875178210510848:12345-0@lo:400:kworker.0 Request processed in 43us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309507.557991:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:0.0:1788309507.558029:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788309507.558033:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788309507.558127:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8efefaa00 x1875178210510848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788309523 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788309507.558138:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8efefaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210510848:0@lo:400:kworker.0 00000100:00100000:1.0:1788309507.558390:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788309507.558398:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecdaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875178210510976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309507.558443:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecdaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875178210510976:12345-0@lo:400:kworker.0 Request processed in 46us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309507.558450:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788309507.558491:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8efefb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875178210510976:0@lo:400:kworker.0 00010000:00010000:1.0:1788309507.808420:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788309508.045534:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309508.045641:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309508.045749:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192649728 00000100:00100000:3.0:1788309508.045760:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192649728 00000100:00100000:3.0:1788309508.045820:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 245 00000100:00100000:3.0:1788309508.045831:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6a6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8351692-8d1a-4b41-bdaf-bf179786ff59+13:2352:x1875178192649728:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788309508.045899:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6a6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8351692-8d1a-4b41-bdaf-bf179786ff59+13:2352:x1875178192649728:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 70us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309508.045907:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 245 00000100:00100000:0.0:1788309508.046771:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309508.051106:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192649856 00000100:00100000:2.0:1788309508.051122:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192649856 00000100:00100000:2.0:1788309508.051201:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192649984 00000100:00100000:2.0:1788309508.051205:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192649984 00000100:00100000:2.0:1788309508.051238:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 89 00000100:00100000:2.0:1788309508.051248:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8eff0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:2352:x1875178192649856:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:2.0:1788309508.051349:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8eff0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:2352:x1875178192649856:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 102us (5825us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309508.051576:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 89 00000100:00100000:2.0:1788309508.051608:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 90 00000100:00100000:2.0:1788309508.051617:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8eff0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ea7f0717-c12d-4408-bdfd-5a035f695b73+5:2352:x1875178192649984:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:2.0:1788309508.051658:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8eff0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ea7f0717-c12d-4408-bdfd-5a035f695b73+5:2352:x1875178192649984:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 42us (4889us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309508.051685:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 90 00000100:00080000:0.0:1788309508.052084:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788309508.064694:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8d6817b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210511232:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788309508.064771:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309508.066652:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210511232 00000100:00100000:3.0:1788309508.066672:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210511232 00000100:00100000:3.0:1788309508.066732:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788309508.066742:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6814000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210511232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788309508.066777:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788309508.066860:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6814000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210511232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (2088us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309508.066868:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1788309508.066909:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8d6817b80 x1875178210511232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788309524 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788309508.066926:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8d6817b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210511232:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788309508.576474:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788309508.576498:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecdad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210511360:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788309508.576573:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309508.576660:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210511360 00000100:00100000:3.0:1788309508.576678:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210511360 00000100:00100000:3.0:1788309508.576743:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788309508.576753:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecdadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875178210511360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788309508.576809:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1788309508.576862:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecdadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875178210511360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309508.576870:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:3.0:1788309508.576922:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8ecdad180 x1875178210511360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788309524 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788309508.576943:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecdad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210511360:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788309508.832566:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309509.856466:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788309510.421815:0:11358:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg255-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788309510.886852:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309511.904753:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788309512.684811:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecdad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3301:1875178210511488:0@lo:400:kworker.0 00000100:00100000:3.0:1788309512.684922:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309512.684984:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecdae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875178210512000:0@lo:400:kworker.0 00000100:00100000:3.0:1788309512.685019:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309512.685050:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788309512.685055:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecdaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210511872:0@lo:400:kworker.0 00000100:00100000:3.0:1788309512.685087:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309512.685124:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecdace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875178210511616:0@lo:400:kworker.0 00000100:00100000:3.0:1788309512.685148:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309512.685163:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecdaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875178210512128:0@lo:400:kworker.0 00000100:00100000:3.0:1788309512.685185:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309512.685206:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788309512.685211:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecdaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875178210511744:0@lo:400:kworker.0 00000100:00100000:3.0:1788309512.685253:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309512.685405:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210511488 00000100:00100000:3.0:1788309512.685416:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210511488 00000100:00100000:3.0:1788309512.685486:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1788309512.685630:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210512000 00000100:00100000:2.0:1788309512.685635:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210512000 00000100:00100000:2.0:1788309512.685681:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210511616 00000100:00100000:2.0:1788309512.685685:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210511616 00000100:00100000:2.0:1788309512.685698:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210511744 00000100:00100000:2.0:1788309512.685700:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210511744 00000100:00100000:2.0:1788309512.685717:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788309512.685725:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecdac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875178210512000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309512.685809:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecdac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875178210512000:12345-0@lo:400:kworker.0 Request processed in 85us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309512.685817:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788309512.685836:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788309512.685843:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecdaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875178210511616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309512.685874:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecdaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875178210511616:12345-0@lo:400:kworker.0 Request processed in 33us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309512.685880:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788309512.685891:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788309512.685897:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecdac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875178210511744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309512.685922:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecdac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875178210511744:12345-0@lo:400:kworker.0 Request processed in 26us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309512.685928:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:2.0:1788309512.685948:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788309512.685987:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecdaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875178210511744:0@lo:400:kworker.0 00000100:00100000:2.0:1788309512.685998:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecdace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875178210511616:0@lo:400:kworker.0 00000100:00100000:2.0:1788309512.686051:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecdae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875178210512000:0@lo:400:kworker.0 00000100:00100000:3.0:1788309512.686474:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6a6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:3301:x1875178210511488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309512.686605:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6a6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:3301:x1875178210511488:12345-0@lo:400:kworker.0 Request processed in 1109us (1682us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309512.686613:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1788309512.686665:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210511872 00000100:00100000:3.0:1788309512.686670:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210511872 00000100:00100000:3.0:1788309512.686705:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210512128 00000100:00100000:3.0:1788309512.686709:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210512128 00000100:00100000:3.0:1788309512.686736:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788309512.686744:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecdaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875178210511872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309512.686790:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecdaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875178210511872:12345-0@lo:400:kworker.0 Request processed in 48us (1702us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309512.686797:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788309512.686810:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788309512.686816:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecdafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875178210512128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309512.686849:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecdafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875178210512128:12345-0@lo:400:kworker.0 Request processed in 33us (1663us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309512.686855:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1788309512.687612:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788309512.687619:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788309512.688024:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8ecdaf480 x1875178210512128/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788309528 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788309512.688042:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecdaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875178210512128:0@lo:400:kworker.0 00010000:00080000:2.0:1788309512.688087:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8ecdaed80 x1875178210511872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788309528 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788309512.688097:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecdaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210511872:0@lo:400:kworker.0 00000100:00100000:2.0:1788309512.688108:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecdad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3301:1875178210511488:0@lo:400:kworker.0 00010000:00010000:0.0:1788309512.929486:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788309513.159790:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309513.159850:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309513.159886:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309513.160264:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192650112 00000100:00100000:0.0:1788309513.160302:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192650112 00000100:00100000:0.0:1788309513.160364:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 247 00000100:00100000:0.0:1788309513.160375:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6b2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8351692-8d1a-4b41-bdaf-bf179786ff59+13:2353:x1875178192650112:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788309513.160468:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6b2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8351692-8d1a-4b41-bdaf-bf179786ff59+13:2353:x1875178192650112:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 94us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309513.160476:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 247 00000100:00100000:2.0:1788309513.160740:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192650240 00000100:00100000:2.0:1788309513.160745:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192650240 00000100:00100000:2.0:1788309513.160803:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192650368 00000100:00100000:2.0:1788309513.160807:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192650368 00000100:00100000:2.0:1788309513.160827:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 94 00000100:00100000:2.0:1788309513.160834:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecdad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:2353:x1875178192650240:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:2.0:1788309513.160874:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecdad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:2353:x1875178192650240:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 40us (1095us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309513.160880:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 94 00000100:00100000:2.0:1788309513.160892:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 95 00000100:00100000:2.0:1788309513.160898:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecdaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ea7f0717-c12d-4408-bdfd-5a035f695b73+5:2353:x1875178192650368:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:2.0:1788309513.160921:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecdaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ea7f0717-c12d-4408-bdfd-5a035f695b73+5:2353:x1875178192650368:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 24us (1034us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309513.161089:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 95 00000100:00080000:0.0:1788309513.161316:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788309513.184797:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8d6816300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210512256:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788309513.184893:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309513.185027:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210512256 00000100:00100000:0.0:1788309513.185036:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210512256 00000100:00100000:0.0:1788309513.185082:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788309513.185092:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecdaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210512256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788309513.185138:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788309513.185183:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecdaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210512256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309513.185191:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1788309513.185339:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8d6816300 x1875178210512256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788309529 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788309513.185365:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8d6816300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210512256:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788309513.697686:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788309513.697715:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8d6815c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210512384:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788309513.697806:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309513.698561:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210512384 00000100:00100000:0.0:1788309513.698572:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210512384 00000100:00100000:0.0:1788309513.698626:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788309513.698637:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8efef9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875178210512384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788309513.698673:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1788309513.698743:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8efef9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875178210512384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (937us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309513.698750:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:2.0:1788309513.699442:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8d6815c00 x1875178210512384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788309529 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788309513.699469:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8d6815c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210512384:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788309513.952496:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788309514.740586:0:11460:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 20:38:32 (1788309512) === 00010000:00010000:3.0:1788309514.977617:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788309515.129045:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309515.134057:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192650624 00000100:00100000:0.0:1788309515.134072:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192650624 00000100:00100000:0.0:1788309515.134156:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 0 00000100:00100000:0.0:1788309515.134171:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecdae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:9667:x1875178192650624:12345-192.168.202.55@tcp:700:mkdir.0 00000100:00100000:0.0:1788309515.134263:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecdae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:9667:x1875178192650624:12345-192.168.202.55@tcp:700:mkdir.0 Request processed in 97us (5230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309515.134308:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 0 00000100:00080000:2.0:1788309515.138948:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788309515.139079:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309515.139153:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192650496 00000100:00100000:2.0:1788309515.139163:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192650496 00000100:00100000:2.0:1788309515.139226:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 14 00000100:00100000:2.0:1788309515.139237:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8eff0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:2351:x1875178192650496:12345-192.168.202.55@tcp:41:mkdir.0 00000004:00000024:2.0:1788309515.139318:0:5838:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788309515.139425:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8eff0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:2351:x1875178192650496:12345-192.168.202.55@tcp:41:mkdir.0 Request processed in 189us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309515.139433:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 14 00000100:00100000:1.0:1788309515.150184:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309515.150309:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192650880 00000100:00100000:3.0:1788309515.150320:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192650880 00000100:00100000:3.0:1788309515.150383:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 15 00000100:00100000:3.0:1788309515.150403:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6815880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:9667:x1875178192650880:12345-192.168.202.55@tcp:36:mkdir.0 00010000:00010000:3.0:1788309515.150463:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788309515.150681:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548600/0x63a04852f462861c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a8fe expref: 6 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.150704:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c8d832f100) 00010000:00010000:3.0:1788309515.150715:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788309515.151069:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e5600/0x63a04852f462873b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.151084:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e5600/0x63a04852f462873b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.151094:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e5600/0x63a04852f462873b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.151121:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e4600/0x63a04852f4628742 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.151128:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e4600/0x63a04852f4628742 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.151143:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e4600/0x63a04852f4628742 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788309515.162030:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:3.0:1788309515.162052:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e5600/0x63a04852f462873b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.162064:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e5600/0x63a04852f462873b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.162072:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e5600/0x63a04852f462873b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.162079:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c9021e5600 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:3.0:1788309515.162083:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e5600/0x63a04852f462873b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.162091:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e5600/0x63a04852f462873b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.162108:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c8c3d81d00) 00010000:00010000:3.0:1788309515.162111:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788309515.162116:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e5600/0x63a04852f462873b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.162122:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e5600/0x63a04852f462873b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788309515.162146:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000806141cd reply state 000000007e628fee transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e4600/0x63a04852f4628742 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309515.162166:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788309515.162272:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6815880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+7:9667:x1875178192650880:12345-192.168.202.55@tcp:36:mkdir.0 Request processed in 11866us (12093us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788309515.170327:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 15 00010000:00010000:1.0:1788309515.170767:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e4600/0x63a04852f4628742 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309515.170781:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e4600/0x63a04852f4628742 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309515.170790:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e4600/0x63a04852f4628742 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309515.170797:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c9021e4600 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:1.0:1788309515.170801:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e4600/0x63a04852f4628742 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309515.170809:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e4600/0x63a04852f4628742 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309515.170826:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff97c8c3d81b00) 00010000:00010000:1.0:1788309515.170829:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788309515.170835:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e4600/0x63a04852f4628742 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309515.170853:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e4600/0x63a04852f4628742 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309515.186552:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309515.186787:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192651008 00000100:00100000:2.0:1788309515.186798:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192651008 00000100:00100000:2.0:1788309515.186861:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 16 00000100:00100000:2.0:1788309515.186872:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6815c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:9669:x1875178192651008:12345-192.168.202.55@tcp:101:chmod.0 00010000:00010000:2.0:1788309515.186893:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309515.186920:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4628749 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146a983 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309515.186986:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628750 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309515.187013:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628750 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309515.187025:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628750 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788309515.187090:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1788309515.187094:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1788309515.187137:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628750 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309515.187163:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4628749 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a983 expref: 8 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309515.187182:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628750 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a983 expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309515.187191:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c8d83f4f00) 00010000:00010000:2.0:1788309515.187194:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788309515.187198:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8e26d9c00, rc 0) 00000100:00100000:2.0:1788309515.187329:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6815c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+7:9669:x1875178192651008:12345-192.168.202.55@tcp:101:chmod.0 Request processed in 458us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309515.187336:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 16 00000100:00100000:2.0:1788309515.196224:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309515.196348:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192651264 00000100:00100000:1.0:1788309515.196359:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192651264 00000100:00100000:1.0:1788309515.196429:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 17 00000100:00100000:1.0:1788309515.196440:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8efefb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+7:9669:x1875178192651264:12345-192.168.202.55@tcp:36:chmod.0 00010000:00010000:1.0:1788309515.196494:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788309515.196520:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628750 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a983 expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309515.196542:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c8d83f4f00) 00010000:00010000:1.0:1788309515.196566:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788309515.196593:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628757 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309515.196606:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628757 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309515.196616:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628757 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788309515.197012:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e87bbd86 reply state 00000000e891ba69 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628757 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309515.197024:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788309515.197040:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1788309515.197149:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8efefb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+8:9669:x1875178192651264:12345-192.168.202.55@tcp:36:chmod.0 Request processed in 708us (936us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788309515.197164:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 17 00010000:00010000:3.0:1788309515.199802:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628757 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.199824:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628757 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.199833:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628757 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.199840:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8f5548e00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:3.0:1788309515.199845:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628757 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.199852:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628757 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.199869:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c8d832f200) 00010000:00010000:3.0:1788309515.199872:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788309515.199877:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628757 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.199883:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628757 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309515.251006:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309515.251123:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192651392 00000100:00100000:0.0:1788309515.251134:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192651392 00000100:00100000:0.0:1788309515.251196:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 18 00000100:00100000:0.0:1788309515.251208:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8efefaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+7:9670:x1875178192651392:12345-192.168.202.55@tcp:101:chown.0 00010000:00010000:0.0:1788309515.251244:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788309515.251271:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f462875e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146a98a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309515.251365:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef000/0x63a04852f4628765 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309515.251378:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef000/0x63a04852f4628765 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309515.251391:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef000/0x63a04852f4628765 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788309515.251447:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1788309515.251451:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1788309515.251488:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef000/0x63a04852f4628765 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309515.251513:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f462875e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a98a expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309515.251531:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef000/0x63a04852f4628765 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a98a expref: 8 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309515.251727:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c8c2ab9b00) 00010000:00010000:0.0:1788309515.251730:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788309515.251734:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8d73ef000, rc 0) 00000100:00100000:0.0:1788309515.251805:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8efefaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+8:9670:x1875178192651392:12345-192.168.202.55@tcp:101:chown.0 Request processed in 599us (810us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309515.251812:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 18 00000100:00100000:1.0:1788309515.262307:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309515.263045:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192651520 00000100:00100000:2.0:1788309515.263056:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192651520 00000100:00100000:2.0:1788309515.263135:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 19 00000100:00100000:2.0:1788309515.263147:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6816300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+8:9670:x1875178192651520:12345-192.168.202.55@tcp:101:chown.0 00010000:00010000:2.0:1788309515.263184:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309515.263217:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f462876c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146a991 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309515.263503:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9800/0x63a04852f4628773 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309515.263519:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9800/0x63a04852f4628773 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309515.263970:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9800/0x63a04852f4628773 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309515.263994:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f462877a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309515.264003:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f462877a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309515.264010:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f462877a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309515.264134:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4628781 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309515.264144:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4628781 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309515.264152:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4628781 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788309515.264190:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:2.0:1788309515.264203:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788309515.264244:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4628781 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309515.265969:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9800/0x63a04852f4628773 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309515.265980:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9800/0x63a04852f4628773 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309515.265988:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9800/0x63a04852f4628773 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309515.265996:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d9800 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309515.266000:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9800/0x63a04852f4628773 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309515.266008:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9800/0x63a04852f4628773 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309515.266026:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c8c2ab9b00) 00010000:00010000:2.0:1788309515.266029:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788309515.266034:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9800/0x63a04852f4628773 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309515.266040:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9800/0x63a04852f4628773 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309515.266059:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f462877a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309515.266066:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f462877a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309515.266090:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f462877a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309515.266096:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d9c00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309515.266099:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f462877a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309515.266106:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f462877a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309515.266114:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff97c8d83f4c00) 00010000:00010000:2.0:1788309515.266117:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788309515.266120:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f462877a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309515.266126:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f462877a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309515.266174:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f462876c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a991 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309515.266190:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4628781 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a991 expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309515.266198:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff97c8d83f4e00) 00010000:00010000:2.0:1788309515.266201:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788309515.266963:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8e26d8600, rc 0) 00000100:00100000:2.0:1788309515.267051:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6816300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+9:9670:x1875178192651520:12345-192.168.202.55@tcp:101:chown.0 Request processed in 3903us (4779us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309515.267073:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 19 00000100:00100000:1.0:1788309515.272957:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309515.273748:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192651776 00000100:00100000:0.0:1788309515.273761:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192651776 00000100:00100000:0.0:1788309515.273826:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 20 00000100:00100000:0.0:1788309515.273836:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6817b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+9:9670:x1875178192651776:12345-192.168.202.55@tcp:36:chown.0 00010000:00010000:0.0:1788309515.274008:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788309515.274034:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4628781 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a991 expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309515.274056:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff97c8d83f4e00) 00010000:00010000:0.0:1788309515.274066:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788309515.274166:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f4628788 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309515.274182:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f4628788 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309515.274193:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f4628788 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788309515.365146:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:0.0:1788309515.365416:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cbff9c35 reply state 0000000077a089c1 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f4628788 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309515.365446:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788309515.365609:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:0.0:1788309515.365720:0:5838:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1788309515.365747:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6817b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+7:9670:x1875178192651776:12345-192.168.202.55@tcp:36:chown.0 Request processed in 91898us (92787us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788309515.365829:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 20 00010000:00010000:0.0:1788309515.366420:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f4628788 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309515.366431:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f4628788 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309515.366439:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f4628788 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309515.366446:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8d73ef200 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:0.0:1788309515.366451:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f4628788 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309515.366459:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f4628788 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309515.366476:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff97c8c2ab9800) 00010000:00010000:0.0:1788309515.366480:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788309515.366484:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f4628788 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309515.366491:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f4628788 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309515.396531:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309515.398584:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192651904 00000100:00100000:3.0:1788309515.398599:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192651904 00000100:00100000:2.0:1788309515.401664:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 21 00000100:00100000:2.0:1788309515.401680:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8eff0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:9671:x1875178192651904:12345-192.168.202.55@tcp:101:touch.500 00010000:00010000:2.0:1788309515.401709:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309515.401734:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f462878f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146a998 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788309515.408355:0:5837:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 6552us 00010000:00010000:0.0:1788309515.453761:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f4628796 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309515.453787:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f4628796 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309515.453799:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f4628796 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309515.453818:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f462879d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309515.453826:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f462879d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309515.453832:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f462879d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309515.454772:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f46287a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309515.454786:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f46287a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309515.454795:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f46287a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788309515.454879:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1788309515.454884:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788309515.454981:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f46287a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309515.454995:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f4628796 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309515.455009:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f4628796 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309515.455016:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f4628796 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309515.455022:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8d73ef200 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:0.0:1788309515.455026:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f4628796 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309515.455034:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f4628796 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309515.455047:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c8c2ab9b00) 00010000:00010000:0.0:1788309515.455050:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788309515.455054:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f4628796 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309515.455060:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f4628796 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309515.455073:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f462879d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309515.455080:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f462879d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309515.455086:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f462879d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309515.455091:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8d73ee400 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:0.0:1788309515.455100:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f462879d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309515.455106:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f462879d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309515.455115:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff97c8c2ab9800) 00010000:00010000:0.0:1788309515.455117:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788309515.455120:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f462879d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309515.455126:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f462879d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309515.455173:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f462878f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a998 expref: 8 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309515.455190:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f46287a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a998 expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309515.455199:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff97c8c2ab9200) 00010000:00010000:0.0:1788309515.455201:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788309515.455203:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8d73ef800, rc 0) 00000100:00100000:0.0:1788309515.455321:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8eff0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+7:9671:x1875178192651904:12345-192.168.202.55@tcp:101:touch.500 Request processed in 53644us (58800us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309515.455328:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 21 00000100:00100000:2.0:1788309515.462997:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309515.463634:0:8305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192652160 00000100:00100000:3.0:1788309515.463646:0:8305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192652160 00000100:00100000:3.0:1788309515.463713:0:8305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 22 00000100:00100000:3.0:1788309515.463723:0:8305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8efef9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+7:9671:x1875178192652160:12345-192.168.202.55@tcp:101:touch.500 00010000:00010000:3.0:1788309515.463759:0:8305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309515.463782:0:8305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e5600/0x63a04852f46287ab lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146a99f expref: -99 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.464179:0:8305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e4200/0x63a04852f46287b2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.464195:0:8305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e4200/0x63a04852f46287b2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.464713:0:8305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e4200/0x63a04852f46287b2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.464783:0:8305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e4c00/0x63a04852f46287b9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.464792:0:8305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e4c00/0x63a04852f46287b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.464800:0:8305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e4c00/0x63a04852f46287b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788309515.470975:0:8305:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:2.0:1788309515.471387:0:8305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f46287c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309515.471405:0:8305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f46287c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309515.471418:0:8305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f46287c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309515.471457:0:8305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e4200/0x63a04852f46287b2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309515.471464:0:8305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e4200/0x63a04852f46287b2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309515.471471:0:8305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e4200/0x63a04852f46287b2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309515.471477:0:8305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c9021e4200 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309515.471482:0:8305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e4200/0x63a04852f46287b2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309515.471497:0:8305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e4200/0x63a04852f46287b2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309515.471512:0:8305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff97c8c2ab9200) 00010000:00010000:2.0:1788309515.473179:0:8305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788309515.473195:0:8305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e4200/0x63a04852f46287b2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309515.473218:0:8305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e4200/0x63a04852f46287b2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788309515.473239:0:8305:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bbf91e3f reply state 0000000025116dcc transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e4c00/0x63a04852f46287b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309515.473250:0:8305:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788309515.473475:0:8305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e5600/0x63a04852f46287ab lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a99f expref: 10 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309515.473493:0:8305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f46287c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a99f expref: 9 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309515.473502:0:8305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff97c8d83f4c00) 00010000:00010000:2.0:1788309515.473504:0:8305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788309515.473506:0:8305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8e26d9c00, rc 0) 00000100:00100000:2.0:1788309515.473714:0:8305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8efef9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+10:9671:x1875178192652160:12345-192.168.202.55@tcp:101:touch.500 Request processed in 9990us (10723us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788309515.473723:0:8305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 22 00000100:00100000:1.0:1788309515.489470:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309515.489643:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192652416 00000100:00100000:2.0:1788309515.489668:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192652416 00000100:00100000:2.0:1788309515.489744:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 23 00000100:00100000:2.0:1788309515.489757:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6816a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+10:9671:x1875178192652416:12345-192.168.202.55@tcp:36:touch.500 00010000:00010000:2.0:1788309515.489818:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788309515.489847:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f46287c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a99f expref: 10 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309515.489867:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff97c8d83f4c00) 00010000:00010000:2.0:1788309515.489879:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788309515.489929:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9800/0x63a04852f46287ce lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309515.489943:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9800/0x63a04852f46287ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309515.489951:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9800/0x63a04852f46287ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788309515.490093:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008e866d9e reply state 0000000026b75b52 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9800/0x63a04852f46287ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309515.490102:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788309515.490209:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6816a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+11:9671:x1875178192652416:12345-192.168.202.55@tcp:36:touch.500 Request processed in 455us (749us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788309515.490217:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 23 00010000:00010000:3.0:1788309515.493775:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e4c00/0x63a04852f46287b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.493794:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e4c00/0x63a04852f46287b9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.493820:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e4c00/0x63a04852f46287b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.493826:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c9021e4c00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:3.0:1788309515.493831:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e4c00/0x63a04852f46287b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.493838:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e4c00/0x63a04852f46287b9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.493858:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xb7cbccd0 (ffff97c8c3d81d00) 00010000:00010000:3.0:1788309515.493861:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788309515.493866:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e4c00/0x63a04852f46287b9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.493872:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e4c00/0x63a04852f46287b9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.496411:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9800/0x63a04852f46287ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.496431:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9800/0x63a04852f46287ce lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.496439:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9800/0x63a04852f46287ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.496445:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d9800 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:3.0:1788309515.496451:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9800/0x63a04852f46287ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.496480:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9800/0x63a04852f46287ce lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.496497:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff97c8d83f4800) 00010000:00010000:3.0:1788309515.496501:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788309515.496506:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9800/0x63a04852f46287ce lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.496512:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9800/0x63a04852f46287ce lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309515.497128:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309515.497503:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192652544 00000100:00100000:0.0:1788309515.497524:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192652544 00000100:00100000:0.0:1788309515.497588:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 24 00000100:00100000:0.0:1788309515.497599:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6816680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+9:9671:x1875178192652544:12345-192.168.202.55@tcp:101:touch.500 00010000:00010000:0.0:1788309515.497636:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788309515.497657:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f46287d5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146a9a6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309515.497725:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f46287d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a9a6 expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309515.497750:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f46287d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a9a6 expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309515.497772:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff97c8c2ab9800) 00010000:00010000:0.0:1788309515.497775:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788309515.497778:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8d73ee400, rc 0) 00000100:00100000:0.0:1788309515.497850:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6816680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+10:9671:x1875178192652544:12345-192.168.202.55@tcp:101:touch.500 Request processed in 252us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309515.497857:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 24 00000100:00100000:1.0:1788309515.503611:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309515.503764:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192652672 00000100:00100000:3.0:1788309515.503775:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192652672 00000100:00100000:3.0:1788309515.503825:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 16 00000100:00100000:3.0:1788309515.503833:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6814e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2349:x1875178192652672:12345-192.168.202.55@tcp:8:touch.500 00010000:00080000:3.0:1788309515.503866:0:6681:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 86451057-f8bb-4d7c-a7c2-5c834b43e3d3@192.168.202.55@tcp t0 exp 0000000000000000 cur 278 last 0 00000020:00000080:3.0:1788309515.503897:0:6681:0:(genops.c:1385:class_connect()) connect: client 86451057-f8bb-4d7c-a7c2-5c834b43e3d3, cookie 0x63a04852f46287dc 00002000:00100000:3.0:1788309515.503910:0:6681:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 86451057-f8bb-4d7c-a7c2-5c834b43e3d3/ffff97c8f5199800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392d ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788309515.503935:0:6681:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788309515.504188:0:6681:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788309515.504230:0:6681:0:(import.c:65:import_set_state_nolock()) ffff97c8f519f800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788309515.504329:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6814e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:2349:x1875178192652672:12345-192.168.202.55@tcp:8:touch.500 Request processed in 495us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309515.504337:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 16 00000100:00100000:3.0:1788309515.507128:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309515.507265:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192652800 00000100:00100000:1.0:1788309515.507324:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192652800 00000100:00100000:1.0:1788309515.507477:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 17 00000100:00100000:1.0:1788309515.507489:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecdace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:0:x1875178192652800:12345-192.168.202.55@tcp:2:touch.500 00000100:00080000:2.0:1788309515.512148:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1788309515.603065:0:7639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:2.0:1788309515.603872:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecdace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:0:x1875178192652800:12345-192.168.202.55@tcp:2:touch.500 Request processed in 96377us (96751us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788309515.603885:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 17 00000001:00100000:0.0:1788309515.604173:0:7639:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 86451057-f8bb-4d7c-a7c2-5c834b43e3d3 00000100:00100000:0.0:1788309515.609767:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309515.610009:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192653056 00000100:00100000:2.0:1788309515.610025:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192653056 00000100:00100000:2.0:1788309515.610170:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 2 00000100:00100000:2.0:1788309515.610182:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8eff0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+10:9671:x1875178192653056:12345-192.168.202.55@tcp:35:touch.500 00000100:00100000:2.0:1788309515.612412:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8eff0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+11:9671:x1875178192653056:12345-192.168.202.55@tcp:35:touch.500 Request processed in 2017us (2446us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788309515.612429:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 2 00000100:00100000:3.0:1788309515.631498:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309515.631548:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192653184 00000100:00100000:2.0:1788309515.631565:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192653184 00000100:00100000:2.0:1788309515.631720:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 25 00000100:00100000:2.0:1788309515.631732:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecdaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+11:9672:x1875178192653184:12345-192.168.202.55@tcp:101:rm.0 00010000:00010000:2.0:1788309515.631767:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309515.631790:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f46287e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146a9ad expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309515.631859:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9600/0x63a04852f46287ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309515.631873:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9600/0x63a04852f46287ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309515.631885:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9600/0x63a04852f46287ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788309515.631946:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1788309515.631951:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1788309515.631991:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9600/0x63a04852f46287ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309515.632019:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f46287e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a9ad expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309515.632056:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9600/0x63a04852f46287ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a9ad expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309515.632064:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff97c8c2ab9200) 00010000:00010000:2.0:1788309515.632067:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788309515.632071:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8e26d9600, rc 0) 00000100:00100000:2.0:1788309515.632162:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecdaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+12:9672:x1875178192653184:12345-192.168.202.55@tcp:101:rm.0 Request processed in 433us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309515.632169:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 25 00000100:00100000:3.0:1788309515.642894:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309515.643016:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192653440 00000100:00100000:0.0:1788309515.643036:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192653440 00000100:00100000:0.0:1788309515.643120:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 26 00000100:00100000:0.0:1788309515.643132:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecdc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+12:9672:x1875178192653440:12345-192.168.202.55@tcp:101:rm.0 00010000:00010000:0.0:1788309515.643156:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788309515.643180:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73efe00/0x63a04852f46287f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146a9b4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788309515.643511:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1788309515.643939:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73efe00/0x63a04852f46287f1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a9b4 expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309515.643957:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c8c2ab9b00) 00010000:00010000:0.0:1788309515.643960:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788309515.643966:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73efe00/0x63a04852f46287f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a9b4 expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309515.643980:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8d73efe00, rc 0) 00000100:00100000:0.0:1788309515.644060:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecdc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+13:9672:x1875178192653440:12345-192.168.202.55@tcp:101:rm.0 Request processed in 929us (1180us total) trans 4294967303 rc 301/301 00000100:00100000:0.0:1788309515.644068:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 26 00000100:00100000:3.0:1788309515.657542:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309515.659360:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192653568 00000100:00100000:0.0:1788309515.659376:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192653568 00000100:00100000:0.0:1788309515.659449:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 3 00000100:00100000:0.0:1788309515.659461:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecdc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+13:9672:x1875178192653568:12345-192.168.202.55@tcp:37:rm.0 00000100:00100000:2.0:1788309515.685386:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecdc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+13:9672:x1875178192653568:12345-192.168.202.55@tcp:37:rm.0 Request processed in 25915us (27842us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309515.685399:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 3 00000100:00100000:2.0:1788309515.706525:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309515.711897:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192653824 00000100:00100000:0.0:1788309515.711915:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192653824 00000100:00100000:0.0:1788309515.712076:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 4 00000100:00100000:0.0:1788309515.712088:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c7000850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+13:9672:x1875178192653824:12345-192.168.202.55@tcp:35:rm.0 00000100:00100000:0.0:1788309515.712399:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c7000850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+14:9672:x1875178192653824:12345-192.168.202.55@tcp:35:rm.0 Request processed in 313us (5885us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788309515.712407:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 4 00000100:00100000:1.0:1788309515.720058:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309515.720154:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192654080 00000100:00100000:0.0:1788309515.720181:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192654080 00000100:00100000:0.0:1788309515.720445:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 27 00000100:00100000:0.0:1788309515.720457:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f4ce3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+14:9672:x1875178192654080:12345-192.168.202.55@tcp:101:rm.0 00010000:00010000:0.0:1788309515.720483:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788309515.720504:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73efe00/0x63a04852f46287ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146a9bb expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309515.720632:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4628806 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309515.720647:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4628806 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309515.720658:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4628806 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788309515.720687:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1788309515.720829:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73efe00/0x63a04852f46287ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a9bb expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309515.720848:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4628806 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a9bb expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309515.720857:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff97c8c2ab9200) 00010000:00010000:0.0:1788309515.720860:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788309515.720864:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8d73eee00, rc 0) 00000100:00100000:0.0:1788309515.720929:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f4ce3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+16:9672:x1875178192654080:12345-192.168.202.55@tcp:101:rm.0 Request processed in 474us (883us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788309515.720937:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 27 00000100:00100000:1.0:1788309515.727387:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309515.734769:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192654208 00000100:00100000:2.0:1788309515.734789:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192654208 00000100:00100000:2.0:1788309515.734938:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 28 00000100:00100000:2.0:1788309515.734951:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f4ce2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+16:9672:x1875178192654208:12345-192.168.202.55@tcp:41:rm.0 00000004:00000024:2.0:1788309515.735020:0:5839:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7718567936 avail 7714373632 00000100:00100000:2.0:1788309515.735104:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f4ce2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+16:9672:x1875178192654208:12345-192.168.202.55@tcp:41:rm.0 Request processed in 155us (7728us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309515.735112:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 28 00000100:00100000:1.0:1788309515.750192:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309515.750419:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192654336 00000100:00100000:0.0:1788309515.750438:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192654336 00000100:00100000:0.0:1788309515.750517:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 29 00000100:00100000:0.0:1788309515.750528:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f4ce3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+16:9672:x1875178192654336:12345-192.168.202.55@tcp:101:rm.0 00010000:00010000:0.0:1788309515.750552:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788309515.750577:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73efe00/0x63a04852f4628814 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146a9c2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309515.750650:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f462881b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309515.750803:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f462881b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309515.750818:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f462881b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309515.750859:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2fc00/0x63a04852f4628822 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309515.750868:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2fc00/0x63a04852f4628822 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309515.750875:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2fc00/0x63a04852f4628822 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.751163:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e4600/0x63a04852f4628829 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.751180:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e4600/0x63a04852f4628829 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.751194:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e4600/0x63a04852f4628829 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788309515.751241:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788309515.751246:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788309515.751273:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e4600/0x63a04852f4628829 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.751315:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e4600/0x63a04852f4628829 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.751327:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f462881b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.751335:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f462881b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.751344:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f462881b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.751352:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8d73ef200 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:3.0:1788309515.751357:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f462881b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.751366:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f462881b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.751401:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff97c8c2ab9200) 00010000:00010000:3.0:1788309515.751405:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788309515.751411:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f462881b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.751419:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f462881b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.751437:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2fc00/0x63a04852f4628822 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.751444:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2fc00/0x63a04852f4628822 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.751451:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2fc00/0x63a04852f4628822 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.751457:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8ecf2fc00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:3.0:1788309515.751460:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2fc00/0x63a04852f4628822 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.751466:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2fc00/0x63a04852f4628822 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.751474:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xb7cbccd0 (ffff97c8c2ab9f00) 00010000:00010000:3.0:1788309515.751477:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788309515.751480:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2fc00/0x63a04852f4628822 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.751487:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2fc00/0x63a04852f4628822 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.751546:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73efe00/0x63a04852f4628814 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a9c2 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.751562:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e4600/0x63a04852f4628829 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a9c2 expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.751571:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff97c8c2ab9800) 00010000:00010000:3.0:1788309515.751573:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788309515.751576:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c9021e4600, rc 0) 00000100:00100000:3.0:1788309515.751662:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f4ce3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+17:9672:x1875178192654336:12345-192.168.202.55@tcp:101:rm.0 Request processed in 1135us (1487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309515.751672:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 29 00000100:00100000:1.0:1788309515.757757:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309515.758135:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192654592 00000100:00100000:0.0:1788309515.758150:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192654592 00000100:00100000:0.0:1788309515.758235:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 30 00000100:00100000:0.0:1788309515.758248:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f4ce1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+17:9672:x1875178192654592:12345-192.168.202.55@tcp:36:rm.0 00010000:00010000:0.0:1788309515.758372:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788309515.758427:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e4600/0x63a04852f4628829 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a9c2 expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309515.758455:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f46287d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a9a6 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309515.758470:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff97c8c2ab9800) 00010000:00010000:0.0:1788309515.758501:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9600/0x63a04852f46287ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a9ad expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309515.758512:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff97c8c2ab9200) 00010000:00010000:0.0:1788309515.758516:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788309515.758541:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e600/0x63a04852f4628830 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309515.758556:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e600/0x63a04852f4628830 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309515.758568:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e600/0x63a04852f4628830 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309515.758584:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2fa00/0x63a04852f4628837 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309515.758592:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2fa00/0x63a04852f4628837 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309515.758599:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2fa00/0x63a04852f4628837 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309515.758768:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f600/0x63a04852f462883e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309515.758784:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f600/0x63a04852f462883e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309515.758792:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f600/0x63a04852f462883e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788309515.760689:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1788309515.760702:0:5837:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 278511424504ns, next at 279511422335ns, rc = 0 00010000:00010000:2.0:1788309515.760781:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4628845 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309515.760808:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4628845 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309515.760820:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4628845 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309515.760830:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4628845 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309515.760836:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4628845 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309515.760842:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4628845 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309515.760866:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788309515.760886:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f600/0x63a04852f462883e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309515.760891:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f600/0x63a04852f462883e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309515.760897:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f600/0x63a04852f462883e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309515.760903:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8ecf2f600 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309515.760907:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f600/0x63a04852f462883e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309515.760914:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f600/0x63a04852f462883e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309515.760937:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff97c8c2ab9900) 00010000:00010000:2.0:1788309515.760940:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788309515.760946:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f600/0x63a04852f462883e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309515.760953:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f600/0x63a04852f462883e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309515.760976:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e600/0x63a04852f4628830 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309515.760976:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788309515.760996:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e600/0x63a04852f4628830 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309515.760996:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4628845 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309515.761036:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d9a00 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:2.0:1788309515.761037:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e600/0x63a04852f4628830 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309515.761048:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4628845 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309515.761050:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8ecf2e600 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309515.761057:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e600/0x63a04852f4628830 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309515.761073:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4628845 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309515.761075:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e600/0x63a04852f4628830 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309515.761093:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff97c8c2ab9200) 00010000:00010000:2.0:1788309515.761095:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788309515.761101:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e600/0x63a04852f4628830 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309515.761117:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e600/0x63a04852f4628830 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309515.761125:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff97c8c2ab9900) 00010000:00010000:1.0:1788309515.761138:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788309515.761149:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4628845 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788309515.761154:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000044b77fec reply state 00000000e201e6cb transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2fa00/0x63a04852f4628837 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309515.761168:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788309515.761178:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4628845 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309515.761211:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309515.761216:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309515.761219:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788309515.761271:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f4ce1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+16:9672:x1875178192654592:12345-192.168.202.55@tcp:36:rm.0 Request processed in 3020us (3533us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788309515.761306:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 30 00000100:00100000:1.0:1788309515.768205:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00010000:00010000:2.0:1788309515.768259:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2fa00/0x63a04852f4628837 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309515.768496:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2fa00/0x63a04852f4628837 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309515.768506:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2fa00/0x63a04852f4628837 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309515.768513:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8ecf2fa00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309515.768518:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2fa00/0x63a04852f4628837 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309515.768525:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2fa00/0x63a04852f4628837 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309515.768545:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xb7cbccd0 (ffff97c8c2ab9500) 00010000:00010000:2.0:1788309515.768548:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788309515.768553:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2fa00/0x63a04852f4628837 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309515.768559:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2fa00/0x63a04852f4628837 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309515.768858:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192654848 00000100:00100000:0.0:1788309515.768875:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192654848 00000100:00100000:0.0:1788309515.768969:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 5 00000100:00100000:0.0:1788309515.768987:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f4ce2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+15:9672:x1875178192654848:12345-192.168.202.55@tcp:35:rm.0 00000100:00100000:0.0:1788309515.769445:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f4ce2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+16:9672:x1875178192654848:12345-192.168.202.55@tcp:35:rm.0 Request processed in 462us (1255us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788309515.769455:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 5 00000100:00100000:1.0:1788309515.771819:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309515.771918:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192655104 00000100:00100000:3.0:1788309515.771936:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192655104 00000100:00100000:3.0:1788309515.772026:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 31 00000100:00100000:3.0:1788309515.772039:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f4ce0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+16:9672:x1875178192655104:12345-192.168.202.55@tcp:36:rm.0 00010000:00010000:3.0:1788309515.772151:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788309515.772190:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4628806 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a9bb expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.772217:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f46287a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a998 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.772231:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff97c8c2ab9200) 00010000:00010000:3.0:1788309515.772249:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef000/0x63a04852f4628765 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a98a expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.772337:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c8c2ab9b00) 00010000:00010000:3.0:1788309515.772346:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788309515.772381:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e4c00/0x63a04852f462884c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.772396:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e4c00/0x63a04852f462884c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.772408:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e4c00/0x63a04852f462884c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.772425:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e5600/0x63a04852f4628853 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.772433:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e5600/0x63a04852f4628853 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.772439:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e5600/0x63a04852f4628853 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.772861:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e4200/0x63a04852f462885a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.772871:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e4200/0x63a04852f462885a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.772878:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e4200/0x63a04852f462885a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788309515.773676:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1788309515.773698:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e4200/0x63a04852f462885a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.773717:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e4200/0x63a04852f462885a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.773725:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e4200/0x63a04852f462885a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.773731:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c9021e4200 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:3.0:1788309515.773750:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e4200/0x63a04852f462885a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.773760:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e4200/0x63a04852f462885a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.773776:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff97c8c3d81d00) 00010000:00010000:3.0:1788309515.773779:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788309515.773784:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e4200/0x63a04852f462885a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.773791:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e4200/0x63a04852f462885a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.773824:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e4c00/0x63a04852f462884c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.773831:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e4c00/0x63a04852f462884c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.773838:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e4c00/0x63a04852f462884c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.773844:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c9021e4c00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:3.0:1788309515.773853:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e4c00/0x63a04852f462884c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.773860:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e4c00/0x63a04852f462884c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.773869:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c8c3d81500) 00010000:00010000:3.0:1788309515.773872:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788309515.773875:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e4c00/0x63a04852f462884c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.773882:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e4c00/0x63a04852f462884c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788309515.773895:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f66288bf reply state 000000006507fff0 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e5600/0x63a04852f4628853 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309515.773907:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788309515.774013:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f4ce0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+15:9672:x1875178192655104:12345-192.168.202.55@tcp:36:rm.0 Request processed in 1972us (2201us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788309515.774023:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 31 00010000:00010000:3.0:1788309515.782161:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e5600/0x63a04852f4628853 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.782182:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e5600/0x63a04852f4628853 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.782191:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e5600/0x63a04852f4628853 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.782198:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c9021e5600 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:3.0:1788309515.782217:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e5600/0x63a04852f4628853 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.782244:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e5600/0x63a04852f4628853 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.782264:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff97c8c3d81800) 00010000:00010000:3.0:1788309515.782267:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788309515.782272:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e5600/0x63a04852f4628853 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309515.782297:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c9021e5600/0x63a04852f4628853 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309516.001467:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309517.031074:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788309517.796670:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210512896:0@lo:400:kworker.0 00000100:00100000:0.0:1788309517.796778:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309517.798219:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788309517.798244:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3300:1875178210512512:0@lo:400:kworker.0 00000100:00100000:0.0:1788309517.798342:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309517.800817:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875178210512640:0@lo:400:kworker.0 00000100:00100000:2.0:1788309517.800927:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309517.800980:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875178210513152:0@lo:400:kworker.0 00000100:00100000:2.0:1788309517.801010:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309517.801052:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788309517.801060:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875178210512768:0@lo:400:kworker.0 00000100:00100000:2.0:1788309517.801097:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309517.801133:0:8305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210512640 00000100:00100000:2.0:1788309517.801144:0:8305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210512640 00000100:00100000:2.0:1788309517.801205:0:8305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210512768 00000100:00100000:2.0:1788309517.801209:0:8305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210512768 00000100:00100000:2.0:1788309517.801245:0:8305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788309517.801256:0:8305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8efef8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875178210512640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309517.801370:0:8305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8efef8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875178210512640:12345-0@lo:400:kworker.0 Request processed in 115us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309517.801379:0:8305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788309517.801399:0:8305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788309517.801406:0:8305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8efef9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875178210512768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309517.801434:0:8305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8efef9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875178210512768:12345-0@lo:400:kworker.0 Request processed in 29us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309517.801440:0:8305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788309517.801459:0:10673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210512896 00000100:00100000:2.0:1788309517.801462:0:10673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210512896 00000100:00100000:2.0:1788309517.801489:0:10673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210513152 00000100:00100000:2.0:1788309517.801492:0:10673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210513152 00000100:00100000:2.0:1788309517.801511:0:10673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788309517.801533:0:10673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8eff0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1875178210512896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309517.801568:0:10673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8eff0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1875178210512896:12345-0@lo:400:kworker.0 Request processed in 36us (4791us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309517.801575:0:10673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788309517.801587:0:10673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788309517.801593:0:10673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8efef8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1875178210513152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309517.801619:0:10673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8efef8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1875178210513152:12345-0@lo:400:kworker.0 Request processed in 27us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309517.801626:0:10673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:2.0:1788309517.801644:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788309517.801649:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788309517.801652:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788309517.801690:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875178210512768:0@lo:400:kworker.0 00000100:00100000:2.0:1788309517.801702:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875178210512640:0@lo:400:kworker.0 00010000:00080000:2.0:1788309517.801727:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8eff0f800 x1875178210513152/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788309533 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788309517.801738:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875178210513152:0@lo:400:kworker.0 00000100:00100000:0.0:1788309517.811763:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875178210513024:0@lo:400:kworker.0 00000100:00100000:0.0:1788309517.811861:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788309517.811927:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8eff0c380 x1875178210512896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788309533 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788309517.811946:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210512896:0@lo:400:kworker.0 00000100:00100000:1.0:1788309517.817524:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210512512 00000100:00100000:1.0:1788309517.817548:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210512512 00000100:00100000:2.0:1788309517.817954:0:8305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210513024 00000100:00100000:2.0:1788309517.817962:0:8305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210513024 00000100:00100000:2.0:1788309517.818025:0:8305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788309517.818039:0:8305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8eff0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875178210513024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309517.820255:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1788309517.820307:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6b2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:3300:x1875178210512512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309517.820461:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6b2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:3300:x1875178210512512:12345-0@lo:400:kworker.0 Request processed in 191us (22119us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309517.820470:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1788309517.820613:0:8305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8eff0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875178210513024:12345-0@lo:400:kworker.0 Request processed in 2576us (8750us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309517.820624:0:8305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:2.0:1788309517.820768:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788309517.828619:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3300:1875178210512512:0@lo:400:kworker.0 00000100:00100000:0.0:1788309517.828650:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875178210513024:0@lo:400:kworker.0 00010000:00010000:3.0:1788309518.048490:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788309518.281802:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309518.281840:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309518.281867:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309518.281902:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309518.281941:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192655360 00000100:00100000:1.0:1788309518.281953:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192655360 00000100:00100000:1.0:1788309518.282022:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192655616 00000100:00100000:1.0:1788309518.282025:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192655616 00000100:00100000:1.0:1788309518.282049:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 99 00000100:00100000:1.0:1788309518.282060:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecf16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+14:2352:x1875178192655360:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788309518.282203:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecf16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+14:2352:x1875178192655360:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 144us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309518.282211:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 99 00000100:00100000:1.0:1788309518.282234:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 100 00000100:00100000:1.0:1788309518.282240:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecf15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ea7f0717-c12d-4408-bdfd-5a035f695b73+5:2352:x1875178192655616:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788309518.282264:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecf15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ea7f0717-c12d-4408-bdfd-5a035f695b73+5:2352:x1875178192655616:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 25us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309518.282270:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 100 00000100:00100000:1.0:1788309518.282316:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192655232 00000100:00100000:1.0:1788309518.282320:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192655232 00000100:00100000:1.0:1788309518.282351:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 249 00000100:00100000:1.0:1788309518.282357:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6b2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8351692-8d1a-4b41-bdaf-bf179786ff59+13:2352:x1875178192655232:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788309518.282381:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6b2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8351692-8d1a-4b41-bdaf-bf179786ff59+13:2352:x1875178192655232:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 25us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309518.282387:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 249 00000100:00100000:1.0:1788309518.282417:0:10673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192655488 00000100:00100000:1.0:1788309518.282420:0:10673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192655488 00000100:00100000:1.0:1788309518.282448:0:10673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 55 00000100:00100000:1.0:1788309518.282454:0:10673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecf14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+5:2352:x1875178192655488:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788309518.282479:0:10673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecf14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+5:2352:x1875178192655488:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 25us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309518.282485:0:10673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 55 00000100:00080000:1.0:1788309518.282501:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788309518.282507:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788309518.330815:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210513280:0@lo:13:osp-pre-1-0.0 00000004:00080000:0.0:1788309518.330841:0:8088:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 281081562578ns, next at 282081559017ns, rc = 0 00000100:00100000:3.0:1788309518.330989:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309518.331438:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210513280 00000100:00100000:0.0:1788309518.331448:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210513280 00000100:00100000:0.0:1788309518.331520:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788309518.331532:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecdc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210513280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788309518.331584:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788309518.331659:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecdc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210513280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 129us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309518.331668:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1788309518.332268:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8eff0ea00 x1875178210513280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788309534 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788309518.332339:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210513280:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788309518.817093:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788309518.817129:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecf16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210513408:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788309518.817227:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309518.817504:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210513408 00000100:00100000:3.0:1788309518.817516:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210513408 00000100:00100000:3.0:1788309518.817626:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788309518.817639:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8efef9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875178210513408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788309518.817688:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1788309518.817770:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8efef9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875178210513408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309518.817779:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:2.0:1788309518.817869:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8ecf16a00 x1875178210513408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788309534 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788309518.817896:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecf16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210513408:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788309519.074030:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788309519.975752:0:11610:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:0.0:1788309520.104885:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788309520.399216:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:1.0:1788309520.399320:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000004:00080000:1.0:1788309520.399427:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:3.0:1788309520.399677:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ec687b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210513536:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788309520.399764:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309520.399923:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210513536 00000100:00100000:2.0:1788309520.399932:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210513536 00000100:00080000:0.0:1788309520.400038:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788309520.400077:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788309520.400088:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecdc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1875178210513536:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788309520.400115:0:6680:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:2.0:1788309520.400154:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a97700b, atime: 0x6a97700b, ctime: 0x6a97700b, blocks: 0x1 00010000:00010000:2.0:1788309520.400163:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9719e6a/0x63a04852f4628861 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309520.400183:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=283s v=(0 0) 00010000:00010000:2.0:1788309520.400188:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788309520.400195:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9719e6a/0x63a04852f4628861 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309520.400212:0:6680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9719e6a/0x63a04852f4628861 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309520.400223:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9719e6a/0x63a04852f4628861 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309520.400251:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9719e6a/0x63a04852f4628861 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309520.400295:0:6680:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788309520.400842:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecdc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3301:x1875178210513536:12345-0@lo:6:osp-syn-1-0.0 Request processed in 755us (1077us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788309520.400851:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1788309520.400917:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788309520.400924:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9719e6a/0x63a04852f4628861 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309520.400934:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d8800 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:0.0:1788309520.400938:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9719e6a/0x63a04852f4628861 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309520.400947:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9719e6a/0x63a04852f4628861 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309520.400966:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9719e6a/0x63a04852f4628861 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309520.400974:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9719e6a/0x63a04852f4628861 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309520.401007:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309520.401009:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309520.401010:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788309520.401116:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:2.0:1788309520.401264:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97c8ec687b80/2, rc 0, transno 4294967300 00000100:00100000:2.0:1788309520.401271:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ec687b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210513536:0@lo:6:osp-syn-1-0.0 00000020:00000080:3.0:1788309520.884796:0:11659:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffdb968500 20000000:00000080:3.0:1788309520.884815:0:11659:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff97c8f52a1c00 uarg=0000000000000000 20000000:01000000:3.0:1788309520.884855:0:11659:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788309520.884867:0:11659:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788309520.884872:0:11659:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1788309520.890375:0:11661:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1788309520.891656:0:11659:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1788309520.901842:0:11659:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1788309520.901912:0:11659:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:1.0:1788309520.901971:0:11659:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:1.0:1788309520.901991:0:11659:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788309520.902015:0:11659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97c8f5549800/0x63a04852f4628868 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309520.902037:0:11659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c8c153a200/0x63a04852f4628703 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a975 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309520.902045:0:11659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c8e26d8a00/0x63a04852f462870a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a97c expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309520.902054:0:11659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c8c153a000/0x63a04852f4628718 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f4628711 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309520.902061:0:11659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c8c153ac00/0x63a04852f4628726 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f462871f expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309520.902068:0:11659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c8f5548400/0x63a04852f4628734 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f462872d expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309520.902075:0:11659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97c8f5549800/0x63a04852f4628868 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309520.902127:0:11659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c8f5548400/0x63a04852f4628734 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x63a04852f462872d expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309520.902138:0:11659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97c8f5548400/0x63a04852f4628734 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x63a04852f462872d expref: 18 pid: 5830 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309520.902150:0:11659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecf16d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11659:1875178210513664:0@lo:104: 00000100:00100000:1.0:1788309520.902224:0:11659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788309520.902311:0:11659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c8c153ac00/0x63a04852f4628726 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x63a04852f462871f expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309520.902321:0:11659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97c8c153ac00/0x63a04852f4628726 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x63a04852f462871f expref: 18 pid: 5832 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309520.902330:0:11659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecf16a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11659:1875178210513792:0@lo:104: 00000100:00100000:1.0:1788309520.902355:0:11659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788309520.902381:0:11659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c8c153a000/0x63a04852f4628718 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x63a04852f4628711 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309520.902390:0:11659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97c8c153a000/0x63a04852f4628718 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x63a04852f4628711 expref: 18 pid: 5831 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309520.902399:0:11659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8efc4e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11659:1875178210513920:0@lo:104: 00000100:00100000:1.0:1788309520.902418:0:11659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788309520.902431:0:11659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c8e26d8a00/0x63a04852f462870a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a97c expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309520.902436:0:11659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97c8e26d8a00/0x63a04852f462870a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a97c expref: 12 pid: 5831 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309520.902452:0:11659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8efc4d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11659:1875178210514048:192.168.202.55@tcp:104: 00010000:00010000:1.0:1788309520.902586:0:11659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c8c153a200/0x63a04852f4628703 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a975 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309520.902591:0:11659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97c8c153a200/0x63a04852f4628703 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a975 expref: 12 pid: 5830 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309520.902596:0:11659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8efc4fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11659:1875178210514176:192.168.202.55@tcp:104: 00000100:00100000:1.0:1788309520.902643:0:11659:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c8967a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788309520.904093:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788309520.904114:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210513664 00000100:00100000:2.0:1788309520.904123:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210513664 00000100:00100000:2.0:1788309520.904165:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210513792 00000100:00100000:2.0:1788309520.904168:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210513792 00000100:00100000:2.0:1788309520.904191:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210513920 00000100:00100000:2.0:1788309520.904194:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210513920 00000100:00100000:2.0:1788309520.904214:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788309520.904224:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecf16300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+5:11659:x1875178210513664:12345-0@lo:104: 00010000:00010000:2.0:1788309520.904241:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff97c8f5549200/0x63a04852f462872d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x63a04852f4628734 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309520.904341:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788309520.904348:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecf16300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+5:11659:x1875178210513664:12345-0@lo:104: Request processed in 125us (2125us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309520.904355:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788309520.904374:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788309520.904393:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8efc4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+4:11659:x1875178210513792:12345-0@lo:104: 00010000:00010000:2.0:1788309520.904400:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8e00/0x63a04852f462871f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x63a04852f4628726 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309520.904432:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788309520.904436:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8efc4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+4:11659:x1875178210513792:12345-0@lo:104: Request processed in 45us (2082us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309520.904442:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788309520.904455:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788309520.904460:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f51c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+3:11659:x1875178210513920:12345-0@lo:104: 00010000:00010000:2.0:1788309520.904468:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8000/0x63a04852f4628711 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x63a04852f4628718 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309520.904501:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788309520.904506:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f51c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+3:11659:x1875178210513920:12345-0@lo:104: Request processed in 47us (2088us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309520.904512:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:3.0:1788309520.904895:0:7627:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788309520.904902:0:7627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff97c8f5549200/0x63a04852f462872d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x63a04852f4628734 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309520.904910:0:7627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8f5549200 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:3.0:1788309520.904915:0:7627:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff97c8f5549200/0x63a04852f462872d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x63a04852f4628734 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309520.904923:0:7627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff97c8f5549200/0x63a04852f462872d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x63a04852f4628734 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788309520.904930:0:7627:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff97c8f5549200/0x63a04852f462872d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x63a04852f4628734 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788309520.904935:0:7627:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788309520.904974:0:7627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff97c8f5549200/0x63a04852f462872d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f4628734 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309520.904981:0:7627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788309520.905001:0:7627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff97c8f5549200/0x63a04852f462872d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f4628734 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309520.905008:0:7627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff97c8f5549200/0x63a04852f462872d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f4628734 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309520.905021:0:7627:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788309520.905024:0:7627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8e00/0x63a04852f462871f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x63a04852f4628726 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309520.905041:0:7627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d8e00 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:3.0:1788309520.905044:0:7627:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8e00/0x63a04852f462871f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x63a04852f4628726 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309520.905050:0:7627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8e00/0x63a04852f462871f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x63a04852f4628726 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788309520.905055:0:7627:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8e00/0x63a04852f462871f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x63a04852f4628726 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788309520.905060:0:7627:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788309520.905073:0:7627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8e00/0x63a04852f462871f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f4628726 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309520.905078:0:7627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788309520.905084:0:7627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8e00/0x63a04852f462871f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f4628726 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309520.905089:0:7627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8e00/0x63a04852f462871f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f4628726 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309520.905100:0:7627:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788309520.905103:0:7627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8000/0x63a04852f4628711 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x63a04852f4628718 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309520.905108:0:7627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d8000 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:3.0:1788309520.905111:0:7627:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8000/0x63a04852f4628711 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x63a04852f4628718 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309520.905126:0:7627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8000/0x63a04852f4628711 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x63a04852f4628718 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788309520.905132:0:7627:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8000/0x63a04852f4628711 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x63a04852f4628718 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788309520.905136:0:7627:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788309520.905149:0:7627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8000/0x63a04852f4628711 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f4628718 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309520.905155:0:7627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788309520.905176:0:7627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8000/0x63a04852f4628711 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f4628718 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309520.905424:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788309520.905488:0:11659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecf16d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11659:1875178210513664:0@lo:104: 00000100:00100000:1.0:1788309520.905498:0:11659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecf16a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11659:1875178210513792:0@lo:104: 00000100:00100000:1.0:1788309520.905506:0:11659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8efc4e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11659:1875178210513920:0@lo:104: 00010000:00010000:3.0:1788309520.905564:0:7627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8000/0x63a04852f4628711 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f4628718 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309520.905577:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309520.905579:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309520.905580:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788309520.905602:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecdc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3303:1875178210514432:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788309520.905736:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309520.905811:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788309520.905817:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecdc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3303:1875178210514304:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788309520.905840:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309520.907566:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecdc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3300:1875178210514560:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788309520.907809:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788309520.907833:0:7639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000100:00100000:1.0:1788309520.908115:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210514432 00000100:00100000:1.0:1788309520.908123:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210514432 00010000:00010000:1.0:1788309520.908158:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c8c153ac00/0x63a04852f4628726 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63a04852f462871f expref: 19 pid: 5832 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309520.908263:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309520.909345:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210514304 00000100:00100000:2.0:1788309520.909356:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210514304 00010000:00010000:2.0:1788309520.909383:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c8f5548400/0x63a04852f4628734 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63a04852f462872d expref: 20 pid: 5830 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309520.909390:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210514560 00000100:00100000:3.0:1788309520.909397:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210514560 00000100:00100000:2.0:1788309520.909407:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788309520.909420:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecdc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+21:3303:x1875178210514432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788309520.909421:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c8c153a000/0x63a04852f4628718 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63a04852f4628711 expref: 21 pid: 5831 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309520.909437:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788309520.909445:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c8c153ac00/0x63a04852f4628726 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63a04852f462871f expref: 21 pid: 5832 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309520.909465:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788309520.909476:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecdc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+21:3303:x1875178210514304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788309520.909476:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c8c153ac00/0x63a04852f4628726 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x63a04852f462871f expref: 21 pid: 5832 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309520.909491:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788309520.909498:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c8f5548400/0x63a04852f4628734 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63a04852f462872d expref: 21 pid: 5830 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309520.909502:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c8c153ac00/0x63a04852f4628726 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x63a04852f462871f expref: 21 pid: 5832 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309520.909516:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c8f5548400/0x63a04852f4628734 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x63a04852f462872d expref: 21 pid: 5830 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309520.909529:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788309520.909587:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecdc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+20:3303:x1875178210514432:12345-0@lo:103:ldlm_bl.0 Request processed in 171us (3850us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309520.909594:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788309520.909614:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788309520.909703:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6b2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:3300:x1875178210514560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788309520.909712:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788309520.909717:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c8c153a000/0x63a04852f4628718 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63a04852f4628711 expref: 19 pid: 5831 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309520.910390:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecdc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3303:1875178210514432:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788309520.913367:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c8f5548400/0x63a04852f4628734 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x63a04852f462872d expref: 19 pid: 5830 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309520.913367:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c8c153a000/0x63a04852f4628718 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x63a04852f4628711 expref: 19 pid: 5831 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309520.913398:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c8c153a000/0x63a04852f4628718 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x63a04852f4628711 expref: 18 pid: 5831 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309520.913403:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788309520.913409:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788309520.913493:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecdc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+17:3303:x1875178210514304:12345-0@lo:103:ldlm_bl.0 Request processed in 4018us (7650us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309520.913494:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6b2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+17:3300:x1875178210514560:12345-0@lo:103:ldlm_bl.0 Request processed in 3873us (5229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309520.913509:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788309520.913517:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788309520.914097:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecdc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3300:1875178210514560:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788309520.914133:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecdc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3303:1875178210514304:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788309520.915188:0:11659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8efc4d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11659:1875178210514048:192.168.202.55@tcp:104: 00000100:00100000:1.0:1788309520.916903:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309520.916984:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192655744 00000100:00100000:2.0:1788309520.916993:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192655744 00010000:00010000:2.0:1788309520.917043:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c8e26d8a00/0x63a04852f462870a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a97c expref: 13 pid: 5831 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309520.917082:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 33 00000100:00100000:2.0:1788309520.917091:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8efc4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f8351692-8d1a-4b41-bdaf-bf179786ff59+13:2351:x1875178192655744:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788309520.917104:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788309520.917110:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c8e26d8a00/0x63a04852f462870a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a97c expref: 13 pid: 5831 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309520.917122:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c8e26d8a00/0x63a04852f462870a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a97c expref: 13 pid: 5831 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309520.917139:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c8e26d8a00/0x63a04852f462870a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a97c expref: 13 pid: 5831 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309520.917157:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788309520.917217:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8efc4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f8351692-8d1a-4b41-bdaf-bf179786ff59+12:2351:x1875178192655744:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 127us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309520.917225:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 33 00000100:00100000:3.0:1788309520.917479:0:11659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8efc4fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11659:1875178210514176:192.168.202.55@tcp:104: 00010000:00010000:3.0:1788309520.917513:0:11659:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97c8f5549800/0x63a04852f4628868 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309520.920627:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309520.920851:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192655872 00000100:00100000:3.0:1788309520.920860:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192655872 00010000:00010000:3.0:1788309520.920899:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c8c153a200/0x63a04852f4628703 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a975 expref: 12 pid: 5830 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309520.920968:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 34 00000100:00100000:3.0:1788309520.920994:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8efc4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f8351692-8d1a-4b41-bdaf-bf179786ff59+12:2350:x1875178192655872:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788309520.921009:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788309520.921015:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c8c153a200/0x63a04852f4628703 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a975 expref: 12 pid: 5830 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309520.921028:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c8c153a200/0x63a04852f4628703 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a975 expref: 12 pid: 5830 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309520.921045:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c8c153a200/0x63a04852f4628703 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a975 expref: 12 pid: 5830 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309520.921064:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97c8f5549800/0x63a04852f4628868 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309520.921072:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8f5549800/0x63a04852f4628868 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309520.921089:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97c8f5549800/0x63a04852f4628868 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309520.921096:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97c8f5549800/0x63a04852f4628868 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309520.921102:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97c8f5549800/0x63a04852f4628868 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309520.921109:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97c8f5549800/0x63a04852f4628868 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309520.921115:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8f5549800 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:3.0:1788309520.921119:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97c8f5549800/0x63a04852f4628868 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309520.921133:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97c8f5549800/0x63a04852f4628868 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309520.921157:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97c8f5549800/0x63a04852f4628868 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309520.921167:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788309520.921231:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8efc4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f8351692-8d1a-4b41-bdaf-bf179786ff59+11:2350:x1875178192655872:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 238us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309520.921238:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 34 00010000:00010000:1.0:1788309520.921302:0:11659:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97c8f5549800/0x63a04852f4628868 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309520.921311:0:11659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97c8f5549800/0x63a04852f4628868 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309520.921317:0:11659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c8f5549800/0x63a04852f4628868 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309521.120764:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788309521.952398:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788309521.952407:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97c8f519c800 from 7 10000000:01000000:3.0:1788309521.952413:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788309521.952472:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c9021e5600/0x63a04852f462886f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309521.952484:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff97c9021e5600/0x63a04852f462886f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309521.952497:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff97c9021e5600/0x63a04852f462886f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309521.952524:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecdc0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210514688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788309521.952616:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309521.953658:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210514688 00000100:00100000:1.0:1788309521.953669:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210514688 00000100:00100000:1.0:1788309521.953756:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1788309521.953766:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6b2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+16:5834:x1875178210514688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788309521.953781:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788309521.953799:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c8f5549800/0x63a04852f4628876 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x63a04852f462886f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309521.953823:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8f5549800/0x63a04852f4628876 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63a04852f462886f expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309521.953834:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c8f5549800/0x63a04852f4628876 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f462886f expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309521.953843:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8f5549800, rc 0) 00000100:00100000:1.0:1788309521.953897:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6b2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+17:5834:x1875178210514688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (1280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309521.953904:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1788309521.954888:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8e684a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788309521.954931:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecdc0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210514688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788309521.954955:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff97c9021e5600/0x63a04852f462886f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4628876 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309521.954993:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff97c9021e5600/0x63a04852f462886f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x63a04852f4628876 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309521.955066:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecdc0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210514816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788309521.955112:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309521.959265:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8e684a6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788309521.960113:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210514816 00000100:00100000:1.0:1788309521.960125:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210514816 00000100:00100000:1.0:1788309521.960203:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1788309521.960214:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6b2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+17:5834:x1875178210514816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788309521.961551:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6b2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+17:5834:x1875178210514816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1334us (6434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309521.961564:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1788309521.967255:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecdc0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210514816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788309521.967506:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecdc0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210514944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788309521.967600:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309521.967734:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8e684a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788309521.971479:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210514944 00000100:00100000:2.0:1788309521.971493:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210514944 00000100:00100000:2.0:1788309521.971562:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1788309521.971573:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6b2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+17:5834:x1875178210514944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788309521.974756:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6b2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+17:5834:x1875178210514944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3174us (7146us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309521.974771:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1788309521.982184:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecdc0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210514944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788309521.982834:0:11673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ec684a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:11673:1875178210515072:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788309521.983068:0:11673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309521.983120:0:11673:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8ffc8b900 going to sleep for 11 seconds 00000100:00100000:1.0:1788309521.983186:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210515072 00000100:00100000:1.0:1788309521.983192:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210515072 00000100:00100000:1.0:1788309521.983306:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1788309521.983315:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6b2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+17:11673:x1875178210515072:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788309521.983652:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6b2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+17:11673:x1875178210515072:12345-0@lo:502:llog_process_th.0 Request processed in 337us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309521.983660:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1788309521.983746:0:11673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ec684a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:11673:1875178210515072:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788309521.983768:0:11673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788309521.983778:0:11673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788309521.983780:0:11673:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788309521.983786:0:11673:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff97c8f519c800 00000020:00000080:2.0:1788309521.983788:0:11673:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788309521.983864:0:11673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ec684a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:11673:1875178210515200:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788309521.983895:0:11673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309521.995221:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210515200 00000100:00100000:3.0:1788309521.995236:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210515200 00000100:00100000:3.0:1788309521.995302:0:11673:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8ffc8b900 going to sleep for 11 seconds 00000100:00100000:3.0:1788309521.995364:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1788309521.995374:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6b2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+17:11673:x1875178210515200:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788309522.000512:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6b2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+17:11673:x1875178210515200:12345-0@lo:502:llog_process_th.0 Request processed in 5134us (16610us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309522.000524:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1788309522.000609:0:11673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ec684a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:11673:1875178210515200:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788309522.000644:0:11673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788309522.000653:0:11673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788309522.000655:0:11673:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788309522.000663:0:11673:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788309522.000886:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1788309522.000914:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788309522.000926:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c9021e5600/0x63a04852f462886f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4628876 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309522.000936:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff97c9021e5600/0x63a04852f462886f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4628876 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788309522.000946:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788309522.003485:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97c8d6805000 from 7 10000000:01000000:3.0:1788309522.003491:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788309522.003557:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c9021e4c00/0x63a04852f462887d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309522.003569:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff97c9021e4c00/0x63a04852f462887d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309522.003581:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff97c9021e4c00/0x63a04852f462887d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309522.003606:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecdc0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210515328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788309522.003692:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309522.003727:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8e684a840 going to sleep for 11 seconds 00000100:00100000:3.0:1788309522.003757:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210515328 00000100:00100000:3.0:1788309522.003763:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210515328 00000100:00100000:3.0:1788309522.003804:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1788309522.003813:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6b2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+17:5834:x1875178210515328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788309522.003825:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309522.003836:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c9021e4200/0x63a04852f4628884 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x63a04852f462887d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309522.003875:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c9021e4200/0x63a04852f4628884 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63a04852f462887d expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309522.003886:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c9021e4200/0x63a04852f4628884 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f462887d expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309522.003895:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c9021e4200, rc 0) 00000100:00100000:3.0:1788309522.003934:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6b2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+18:5834:x1875178210515328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309522.003941:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1788309522.006569:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecdc0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210515328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788309522.006604:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff97c9021e4c00/0x63a04852f462887d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4628884 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309522.006619:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff97c9021e4c00/0x63a04852f462887d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x63a04852f4628884 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309522.006752:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecdc0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210515456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788309522.006818:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309522.006871:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8e684a840 going to sleep for 11 seconds 00000100:00100000:2.0:1788309522.008192:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210515456 00000100:00100000:2.0:1788309522.008203:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210515456 00000100:00100000:2.0:1788309522.008258:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1788309522.008268:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6ae8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+18:5834:x1875178210515456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788309522.008550:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6ae8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+18:5834:x1875178210515456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 283us (1732us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309522.008558:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788309522.009207:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecdc0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210515456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788309522.009253:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecdc0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210515584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788309522.009310:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309522.009340:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8e684a840 going to sleep for 11 seconds 00000100:00100000:2.0:1788309522.010855:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210515584 00000100:00100000:2.0:1788309522.010864:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210515584 00000100:00100000:2.0:1788309522.010929:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1788309522.010938:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6ae8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+18:5834:x1875178210515584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788309522.011346:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6ae8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+18:5834:x1875178210515584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 407us (2035us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309522.011353:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1788309522.013110:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecdc0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210515584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788309522.014380:0:11676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecdc0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:11676:1875178210515712:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788309522.014461:0:11676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309522.014494:0:11676:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8e684a900 going to sleep for 11 seconds 00000100:00100000:1.0:1788309522.014548:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210515712 00000100:00100000:1.0:1788309522.014554:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210515712 00000100:00100000:1.0:1788309522.014603:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1788309522.014612:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aeb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+18:11676:x1875178210515712:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788309522.015103:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aeb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+18:11676:x1875178210515712:12345-0@lo:502:llog_process_th.0 Request processed in 490us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309522.015112:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1788309522.015403:0:11676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecdc0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:11676:1875178210515712:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788309522.015434:0:11676:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788309522.015445:0:11676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788309522.015452:0:11676:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788309522.015460:0:11676:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff97c8d6805000 00000020:00000080:2.0:1788309522.015462:0:11676:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788309522.015544:0:11676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ec684380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:11676:1875178210515840:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788309522.015587:0:11676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309522.015620:0:11676:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8ffc8b180 going to sleep for 11 seconds 00000100:00100000:3.0:1788309522.017121:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210515840 00000100:00100000:3.0:1788309522.017134:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210515840 00000100:00100000:3.0:1788309522.017202:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1788309522.017213:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6ae9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+18:11676:x1875178210515840:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788309522.017476:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6ae9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+18:11676:x1875178210515840:12345-0@lo:502:llog_process_th.0 Request processed in 264us (1889us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309522.017484:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1788309522.017693:0:11676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ec684380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:11676:1875178210515840:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788309522.017724:0:11676:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788309522.017731:0:11676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788309522.017734:0:11676:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788309522.017739:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788309522.018833:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1788309522.018856:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788309522.018867:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c9021e4c00/0x63a04852f462887d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4628884 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309522.018879:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff97c9021e4c00/0x63a04852f462887d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4628884 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788309522.018890:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788309522.018893:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97c8e07b1000 from 7 10000000:01000000:3.0:1788309522.018895:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788309522.018939:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c9021e4600/0x63a04852f462888b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309522.018947:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff97c9021e4600/0x63a04852f462888b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309522.018958:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff97c9021e4600/0x63a04852f462888b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309522.018985:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecdc0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210515968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788309522.019035:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309522.019073:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8e684a900 going to sleep for 11 seconds 00000100:00100000:1.0:1788309522.019273:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210515968 00000100:00100000:1.0:1788309522.019303:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210515968 00000100:00100000:1.0:1788309522.019348:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1788309522.019358:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+18:5834:x1875178210515968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788309522.019369:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788309522.019382:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c8f5549e00/0x63a04852f4628892 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x63a04852f462888b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309522.019405:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8f5549e00/0x63a04852f4628892 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63a04852f462888b expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309522.019415:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c8f5549e00/0x63a04852f4628892 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f462888b expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309522.019424:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8f5549e00, rc 0) 00000100:00100000:1.0:1788309522.019468:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:5834:x1875178210515968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309522.019481:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1788309522.019570:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecdc0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210515968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788309522.019584:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff97c9021e4600/0x63a04852f462888b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4628892 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309522.019593:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff97c9021e4600/0x63a04852f462888b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x63a04852f4628892 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309522.019642:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ec684380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210516096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788309522.019671:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309522.019699:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8ffc8b180 going to sleep for 11 seconds 00000100:00100000:1.0:1788309522.020733:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210516096 00000100:00100000:1.0:1788309522.020743:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210516096 00000100:00100000:1.0:1788309522.020783:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1788309522.020792:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:5834:x1875178210516096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788309522.021096:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:5834:x1875178210516096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 304us (1423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309522.021103:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1788309522.021228:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ec684380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210516096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788309522.021268:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ec684380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210516224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788309522.021321:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309522.021344:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8ffc8b180 going to sleep for 11 seconds 00000100:00100000:2.0:1788309522.021373:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210516224 00000100:00100000:2.0:1788309522.021376:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210516224 00000100:00100000:2.0:1788309522.021405:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788309522.021412:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6ae9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:5834:x1875178210516224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788309522.021548:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6ae9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:5834:x1875178210516224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 136us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309522.021554:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788309522.021592:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ec684380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:00707c3b-bc67-4313-a42d-1f5d185ea5d5:5834:1875178210516224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788309522.025449:0:11677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ec684380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:11677:1875178210516352:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788309522.025535:0:11677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309522.025576:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210516352 00000100:00100000:2.0:1788309522.025583:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210516352 00000100:00100000:2.0:1788309522.025625:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788309522.025634:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:11677:x1875178210516352:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788309522.025865:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:11677:x1875178210516352:12345-0@lo:502:llog_process_th.0 Request processed in 231us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309522.025873:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788309522.025938:0:11677:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8ffc8b900 going to sleep for 11 seconds 00000100:00100000:2.0:1788309522.026037:0:11677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ec684380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:11677:1875178210516352:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788309522.026064:0:11677:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788309522.026074:0:11677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788309522.026076:0:11677:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788309522.026084:0:11677:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff97c8e07b1000 00000020:00000080:2.0:1788309522.026087:0:11677:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788309522.026155:0:11677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ec684380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:11677:1875178210516480:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788309522.026187:0:11677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309522.026201:0:11677:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8ffc8b900 going to sleep for 11 seconds 00000100:00100000:1.0:1788309522.026732:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210516480 00000100:00100000:1.0:1788309522.026739:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210516480 00000100:00100000:1.0:1788309522.026772:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1788309522.026780:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:11677:x1875178210516480:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788309522.027137:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:11677:x1875178210516480:12345-0@lo:502:llog_process_th.0 Request processed in 357us (948us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309522.027145:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788309522.030801:0:11677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ec684380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:00707c3b-bc67-4313-a42d-1f5d185ea5d5:11677:1875178210516480:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788309522.030850:0:11677:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788309522.030863:0:11677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788309522.030865:0:11677:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788309522.030871:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1788309522.030942:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1788309522.030960:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788309522.030971:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c9021e4600/0x63a04852f462888b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4628892 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309522.030982:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff97c9021e4600/0x63a04852f462888b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4628892 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788309522.032226:0:11678:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788309522.144548:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788309522.314671:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309522.314864:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192656000 00000100:00100000:2.0:1788309522.314881:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192656000 00000100:00100000:2.0:1788309522.314948:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 265 00000100:00100000:2.0:1788309522.314959:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8351692-8d1a-4b41-bdaf-bf179786ff59+11:5592:x1875178192656000:12345-192.168.202.55@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788309522.314977:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309522.314996:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c8e26d9800/0x63a04852f4628899 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8a28c761146a9c9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309522.315037:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8e26d9800/0x63a04852f4628899 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a9c9 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309522.315049:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c8e26d9800/0x63a04852f4628899 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a9c9 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309522.315059:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8e26d9800, rc 0) 00000100:00100000:2.0:1788309522.315124:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8351692-8d1a-4b41-bdaf-bf179786ff59+12:5592:x1875178192656000:12345-192.168.202.55@tcp:101:ll_cfg_requeue.0 Request processed in 167us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309522.315146:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 265 00000100:00100000:0.0:1788309522.318397:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309522.318502:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192656128 00000100:00100000:1.0:1788309522.318513:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192656128 00000100:00100000:1.0:1788309522.318574:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 266 00000100:00100000:1.0:1788309522.318584:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8351692-8d1a-4b41-bdaf-bf179786ff59+12:5592:x1875178192656128:12345-192.168.202.55@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788309522.318937:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8351692-8d1a-4b41-bdaf-bf179786ff59+12:5592:x1875178192656128:12345-192.168.202.55@tcp:501:ll_cfg_requeue.0 Request processed in 353us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309522.318945:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 266 00000100:00100000:1.0:1788309522.321893:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309522.322011:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192656256 00000100:00100000:0.0:1788309522.322022:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192656256 00000100:00100000:0.0:1788309522.322159:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 267 00000100:00100000:0.0:1788309522.322169:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8351692-8d1a-4b41-bdaf-bf179786ff59+12:5592:x1875178192656256:12345-192.168.202.55@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788309522.322632:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8351692-8d1a-4b41-bdaf-bf179786ff59+12:5592:x1875178192656256:12345-192.168.202.55@tcp:503:ll_cfg_requeue.0 Request processed in 343us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309522.322643:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 267 00000100:00100000:0.0:1788309522.326978:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309522.332918:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192656384 00000100:00100000:2.0:1788309522.332942:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192656384 00000100:00100000:2.0:1788309522.333264:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 268 00000100:00100000:2.0:1788309522.333311:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8351692-8d1a-4b41-bdaf-bf179786ff59+12:9943:x1875178192656384:12345-192.168.202.55@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788309522.333682:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8351692-8d1a-4b41-bdaf-bf179786ff59+12:9943:x1875178192656384:12345-192.168.202.55@tcp:502:llog_process_th.0 Request processed in 397us (6708us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309522.333692:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 268 00000100:00100000:3.0:1788309522.341445:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309522.347701:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192656512 00000100:00100000:1.0:1788309522.347748:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192656512 00000100:00100000:1.0:1788309522.347830:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 269 00000100:00100000:1.0:1788309522.347845:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8351692-8d1a-4b41-bdaf-bf179786ff59+12:9943:x1875178192656512:12345-192.168.202.55@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788309522.348223:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8351692-8d1a-4b41-bdaf-bf179786ff59+12:9943:x1875178192656512:12345-192.168.202.55@tcp:502:llog_process_th.0 Request processed in 374us (6786us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309522.348235:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 269 00000100:00100000:1.0:1788309522.358175:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309522.358887:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192656640 00000100:00100000:3.0:1788309522.358904:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192656640 00000100:00100000:3.0:1788309522.358989:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 270 00000100:00100000:3.0:1788309522.359004:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8351692-8d1a-4b41-bdaf-bf179786ff59+12:5592:x1875178192656640:12345-192.168.202.55@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788309522.359028:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309522.359062:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c8d73ef000/0x63a04852f46288a0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8a28c761146a9d0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309522.359103:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8d73ef000/0x63a04852f46288a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a9d0 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309522.359117:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c8d73ef000/0x63a04852f46288a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a9d0 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309522.359153:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8d73ef000, rc 0) 00000100:00100000:3.0:1788309522.359339:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8351692-8d1a-4b41-bdaf-bf179786ff59+13:5592:x1875178192656640:12345-192.168.202.55@tcp:101:ll_cfg_requeue.0 Request processed in 337us (1178us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309522.359348:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 270 00000100:00100000:3.0:1788309522.362223:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309522.362967:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192656768 00000100:00100000:0.0:1788309522.362981:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192656768 00000100:00100000:0.0:1788309522.363060:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 271 00000100:00100000:0.0:1788309522.363271:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8351692-8d1a-4b41-bdaf-bf179786ff59+13:5592:x1875178192656768:12345-192.168.202.55@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788309522.364342:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8351692-8d1a-4b41-bdaf-bf179786ff59+13:5592:x1875178192656768:12345-192.168.202.55@tcp:501:ll_cfg_requeue.0 Request processed in 1267us (2128us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309522.364356:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 271 00000100:00100000:0.0:1788309522.369822:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309522.369929:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192656896 00000100:00100000:3.0:1788309522.369942:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192656896 00000100:00100000:3.0:1788309522.370002:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 272 00000100:00100000:3.0:1788309522.370014:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8351692-8d1a-4b41-bdaf-bf179786ff59+13:5592:x1875178192656896:12345-192.168.202.55@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788309522.370458:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8351692-8d1a-4b41-bdaf-bf179786ff59+13:5592:x1875178192656896:12345-192.168.202.55@tcp:503:ll_cfg_requeue.0 Request processed in 443us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309522.370469:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 272 00000100:00100000:2.0:1788309522.375207:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309522.375861:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192657024 00000100:00100000:1.0:1788309522.375876:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192657024 00000100:00100000:1.0:1788309522.375954:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 273 00000100:00100000:1.0:1788309522.375968:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8351692-8d1a-4b41-bdaf-bf179786ff59+13:9946:x1875178192657024:12345-192.168.202.55@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788309522.376988:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8351692-8d1a-4b41-bdaf-bf179786ff59+13:9946:x1875178192657024:12345-192.168.202.55@tcp:502:llog_process_th.0 Request processed in 1017us (1793us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309522.377001:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 273 00000100:00100000:0.0:1788309522.380256:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309522.380891:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192657152 00000100:00100000:3.0:1788309522.380905:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192657152 00000100:00100000:3.0:1788309522.381034:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 274 00000100:00100000:3.0:1788309522.381047:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8351692-8d1a-4b41-bdaf-bf179786ff59+13:9946:x1875178192657152:12345-192.168.202.55@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788309522.381430:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8351692-8d1a-4b41-bdaf-bf179786ff59+13:9946:x1875178192657152:12345-192.168.202.55@tcp:502:llog_process_th.0 Request processed in 384us (1185us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309522.381445:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 274 00000100:00100000:1.0:1788309522.913832:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788309522.914617:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875178210516864:0@lo:400:kworker.0 00000100:00100000:2.0:1788309522.914697:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875178210516736:0@lo:400:kworker.0 00000100:00100000:2.0:1788309522.914785:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309522.914932:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309522.915062:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210516736 00000100:00100000:2.0:1788309522.915073:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210516736 00000100:00100000:2.0:1788309522.915125:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210516864 00000100:00100000:2.0:1788309522.915129:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210516864 00000100:00100000:2.0:1788309522.915198:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788309522.915209:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ec684380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875178210516736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309522.915296:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ec684380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875178210516736:12345-0@lo:400:kworker.0 Request processed in 69us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309522.915305:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788309522.915326:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788309522.915342:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210516992:0@lo:400:kworker.0 00000100:00100000:2.0:1788309522.915361:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788309522.915371:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ec687100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875178210516864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309522.915388:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309522.915424:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ec687100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875178210516864:12345-0@lo:400:kworker.0 Request processed in 54us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309522.915448:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788309522.915470:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875178210516736:0@lo:400:kworker.0 00000100:00100000:2.0:1788309522.915484:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875178210516864:0@lo:400:kworker.0 00000100:00080000:2.0:1788309522.915525:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788309522.919565:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3300:1875178210516608:0@lo:400:kworker.0 00000100:00100000:1.0:1788309522.925690:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309522.927261:0:10673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210516992 00000100:00100000:1.0:1788309522.927296:0:10673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210516992 00000100:00100000:1.0:1788309522.927408:0:10673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788309522.927435:0:10673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecdc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1875178210516992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309522.927563:0:10673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecdc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1875178210516992:12345-0@lo:400:kworker.0 Request processed in 133us (12175us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309522.927593:0:10673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:1.0:1788309522.927657:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8eff0c000 x1875178210516992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788309538 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788309522.927687:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210516992:0@lo:400:kworker.0 00000100:00100000:2.0:1788309522.927910:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210516608 00000100:00100000:2.0:1788309522.927917:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210516608 00000100:00100000:2.0:1788309522.927966:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1788309522.927976:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:3300:x1875178210516608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309522.928026:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:3300:x1875178210516608:12345-0@lo:400:kworker.0 Request processed in 52us (2359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309522.928032:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1788309522.928441:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788309522.928461:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210517248:0@lo:400:kworker.0 00000100:00080000:3.0:1788309522.928473:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788309522.928512:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309522.928611:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210517248 00000100:00100000:3.0:1788309522.928616:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210517248 00000100:00100000:3.0:1788309522.928679:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788309522.928689:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8eff0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210517248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309522.928736:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8eff0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210517248:12345-0@lo:400:kworker.0 Request processed in 49us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309522.928742:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788309522.928778:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:3.0:1788309522.928785:0:3303:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97c8ec687b80, transno 4294967300 00000100:00100000:3.0:1788309522.928809:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210517248:0@lo:400:kworker.0 00000100:00100000:1.0:1788309522.929430:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875178210517120:0@lo:400:kworker.0 00000100:00100000:1.0:1788309522.929476:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309522.929531:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3300:1875178210516608:0@lo:400:kworker.0 00000100:00100000:2.0:1788309522.929597:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210517120 00000100:00100000:2.0:1788309522.929604:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210517120 00000100:00080000:0.0:1788309522.929667:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788309522.930645:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788309522.930666:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8efc4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875178210517120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309522.930767:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8efc4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875178210517120:12345-0@lo:400:kworker.0 Request processed in 103us (1289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309522.930775:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788309522.931060:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875178210517120:0@lo:400:kworker.0 00000100:00080000:0.0:1788309522.931408:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:0.0:1788309523.042164:0:11678:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788309523.170120:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788309523.405137:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309523.405197:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309523.405617:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192657408 00000100:00100000:0.0:1788309523.405632:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192657408 00000100:00100000:0.0:1788309523.405738:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 104 00000100:00100000:0.0:1788309523.405752:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8efc4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+5:2350:x1875178192657408:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788309523.405873:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8efc4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+5:2350:x1875178192657408:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 123us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309523.405881:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 104 00000100:00100000:3.0:1788309523.406444:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192657280 00000100:00100000:3.0:1788309523.406454:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192657280 00000100:00100000:3.0:1788309523.406508:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 276 00000100:00100000:3.0:1788309523.406518:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8351692-8d1a-4b41-bdaf-bf179786ff59+13:2351:x1875178192657280:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788309523.406571:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8351692-8d1a-4b41-bdaf-bf179786ff59+13:2351:x1875178192657280:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 56us (1454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309523.406579:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 276 00000100:00080000:1.0:1788309523.406974:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788309523.408054:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309523.408687:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192657664 00000100:00100000:2.0:1788309523.408701:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192657664 00000100:00100000:2.0:1788309523.408813:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 105 00000100:00100000:2.0:1788309523.408828:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8efc4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ea7f0717-c12d-4408-bdfd-5a035f695b73+5:2350:x1875178192657664:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:2.0:1788309523.408937:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8efc4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ea7f0717-c12d-4408-bdfd-5a035f695b73+5:2350:x1875178192657664:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 113us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309523.408945:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 105 00000100:00080000:1.0:1788309523.409307:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788309523.419679:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309523.419806:0:10673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192657536 00000100:00100000:1.0:1788309523.419820:0:10673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192657536 00000100:00100000:1.0:1788309523.419941:0:10673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 58 00000100:00100000:1.0:1788309523.419955:0:10673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8eff0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+5:2351:x1875178192657536:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788309523.420062:0:10673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8eff0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+5:2351:x1875178192657536:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 110us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309523.420080:0:10673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 58 00000100:00080000:0.0:1788309523.420643:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788309523.427813:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788309523.427848:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875178210517376:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788309523.427948:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309523.428051:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210517376 00000100:00100000:3.0:1788309523.428064:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210517376 00000100:00100000:3.0:1788309523.428136:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788309523.428148:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6979c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875178210517376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788309523.428210:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788309523.428311:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6979c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875178210517376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 164us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309523.428320:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788309523.428442:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875178210517376:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788309523.936729:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e6979880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210517504:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788309523.936862:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309523.937256:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210517504 00000100:00100000:0.0:1788309523.937267:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210517504 00000100:00100000:0.0:1788309523.937415:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788309523.937427:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ec687800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875178210517504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788309523.937475:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1788309523.937558:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ec687800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875178210517504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309523.937574:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:2.0:1788309523.937874:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8e6979880 x1875178210517504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788309539 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788309523.937900:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e6979880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210517504:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788309524.192765:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309525.216564:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309526.240833:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309527.264851:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788309528.032894:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ec686680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3301:1875178210517632:0@lo:400:kworker.0 00000100:00100000:2.0:1788309528.033003:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309528.033108:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210517632 00000100:00100000:2.0:1788309528.033118:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210517632 00000100:00100000:2.0:1788309528.033181:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1788309528.033192:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:3301:x1875178210517632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309528.033419:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e6979180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875178210517760:0@lo:400:kworker.0 00000100:00100000:1.0:1788309528.033461:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309528.033756:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e697b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875178210517888:0@lo:400:kworker.0 00000100:00100000:1.0:1788309528.033794:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309528.033839:0:8305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210517760 00000100:00100000:1.0:1788309528.033844:0:8305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210517760 00000100:00100000:1.0:1788309528.033884:0:8305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210517888 00000100:00100000:1.0:1788309528.033888:0:8305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210517888 00000100:00100000:1.0:1788309528.033927:0:8305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788309528.033936:0:8305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6978e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875178210517760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309528.034094:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788309528.034105:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e697ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875178210517888:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788309528.034414:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788309528.034789:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875178210518272:0@lo:400:kworker.0 00000100:00100000:2.0:1788309528.034932:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210518016:0@lo:400:kworker.0 00000100:00100000:3.0:1788309528.040882:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e697ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875178210517888:12345-0@lo:400:kworker.0 Request processed in 6761us (7069us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309528.040904:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788309528.041027:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875178210518144:0@lo:400:kworker.0 00000100:00100000:3.0:1788309528.041089:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309528.041335:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:3301:x1875178210517632:12345-0@lo:400:kworker.0 Request processed in 8142us (8331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309528.041344:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1788309528.041406:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ec686680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3301:1875178210517632:0@lo:400:kworker.0 00000100:00100000:3.0:1788309528.041536:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210518144 00000100:00100000:3.0:1788309528.041545:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210518144 00000100:00100000:3.0:1788309528.041613:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788309528.041634:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecdc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875178210518144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309528.041687:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecdc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875178210518144:12345-0@lo:400:kworker.0 Request processed in 64us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309528.041694:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788309528.041731:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875178210518144:0@lo:400:kworker.0 00000100:00080000:3.0:1788309528.041758:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788309528.041816:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e697b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875178210517888:0@lo:400:kworker.0 00000100:00100000:1.0:1788309528.047814:0:8305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6978e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875178210517760:12345-0@lo:400:kworker.0 Request processed in 13863us (14336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309528.047835:0:8305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788309528.055962:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309528.056081:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e6979180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875178210517760:0@lo:400:kworker.0 00000100:00100000:3.0:1788309528.056097:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210518272 00000100:00100000:3.0:1788309528.056111:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210518272 00000100:00080000:0.0:1788309528.056168:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788309528.056200:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788309528.056214:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8eff0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875178210518272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309528.056362:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8eff0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875178210518272:12345-0@lo:400:kworker.0 Request processed in 150us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309528.056371:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788309528.056463:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875178210518272:0@lo:400:kworker.0 00000100:00100000:2.0:1788309528.067098:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309528.069523:0:10673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210518016 00000100:00100000:1.0:1788309528.069546:0:10673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210518016 00000100:00080000:3.0:1788309528.069669:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788309528.069672:0:10673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788309528.069695:0:10673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ec686680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1875178210518016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309528.069838:0:10673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ec686680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1875178210518016:12345-0@lo:400:kworker.0 Request processed in 147us (2751us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309528.069846:0:10673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:3.0:1788309528.070049:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8eff0ca80 x1875178210518016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788309544 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788309528.070069:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210518016:0@lo:400:kworker.0 00010000:00010000:0.0:1788309528.292576:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788309528.519266:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309528.519346:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309528.519567:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309528.519735:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192657792 00000100:00100000:2.0:1788309528.519748:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192657792 00000100:00100000:2.0:1788309528.519897:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 278 00000100:00100000:2.0:1788309528.519909:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8351692-8d1a-4b41-bdaf-bf179786ff59+13:2353:x1875178192657792:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:2.0:1788309528.519998:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8351692-8d1a-4b41-bdaf-bf179786ff59+13:2353:x1875178192657792:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 91us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309528.520006:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 278 00000100:00100000:3.0:1788309528.520236:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192658048 00000100:00100000:3.0:1788309528.520241:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192658048 00000100:00100000:3.0:1788309528.520321:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 61 00000100:00100000:3.0:1788309528.520330:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8eff0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+5:2353:x1875178192658048:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788309528.520617:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8eff0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+5:2353:x1875178192658048:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 285us (1267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309528.520636:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 61 00000100:00100000:1.0:1788309528.520641:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192657920 00000100:00100000:1.0:1788309528.520655:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192657920 00000100:00080000:3.0:1788309528.520671:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788309528.520679:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788309528.520746:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 109 00000100:00100000:1.0:1788309528.520758:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8eff0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+5:2352:x1875178192657920:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788309528.520833:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8eff0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+5:2352:x1875178192657920:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 77us (1266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309528.520873:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 109 00000100:00100000:2.0:1788309528.521713:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309528.522312:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192658176 00000100:00100000:3.0:1788309528.522322:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192658176 00000100:00100000:3.0:1788309528.522519:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 110 00000100:00100000:3.0:1788309528.522541:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ec687b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ea7f0717-c12d-4408-bdfd-5a035f695b73+5:2352:x1875178192658176:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788309528.522629:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ec687b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ea7f0717-c12d-4408-bdfd-5a035f695b73+5:2352:x1875178192658176:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 92us (913us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309528.522638:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 110 00000100:00080000:0.0:1788309528.528342:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788309528.545332:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788309528.545370:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875178210518400:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788309528.545666:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309528.545962:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210518400 00000100:00100000:2.0:1788309528.546038:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210518400 00000100:00100000:2.0:1788309528.546098:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788309528.546108:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e697b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875178210518400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788309528.546272:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788309528.546389:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e697b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875178210518400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 281us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309528.546398:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788309528.546665:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875178210518400:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788309529.057790:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e6979f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210518528:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788309529.057870:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309529.058089:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210518528 00000100:00100000:1.0:1788309529.058098:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210518528 00000100:00100000:1.0:1788309529.058150:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788309529.058160:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecdc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875178210518528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788309529.058197:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1788309529.058237:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecdc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875178210518528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309529.058242:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:3.0:1788309529.058383:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8e6979f80 x1875178210518528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788309545 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788309529.058399:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e6979f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210518528:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788309529.312665:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309530.338028:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309531.362500:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309532.385803:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788309533.153396:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e697a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3301:1875178210518656:0@lo:400:kworker.0 00000100:00100000:0.0:1788309533.153472:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309533.153684:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210518656 00000100:00100000:3.0:1788309533.153703:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210518656 00000100:00100000:3.0:1788309533.153764:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1788309533.153778:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:3301:x1875178210518656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309533.154423:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e6979f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875178210518784:0@lo:400:kworker.0 00000100:00100000:2.0:1788309533.155257:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309533.155314:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788309533.155323:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e6979180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875178210518912:0@lo:400:kworker.0 00000100:00100000:2.0:1788309533.155350:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309533.155381:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e697b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210519040:0@lo:400:kworker.0 00000100:00100000:2.0:1788309533.155408:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309533.156172:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210518784 00000100:00100000:2.0:1788309533.156940:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210518784 00000100:00100000:2.0:1788309533.157015:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210518912 00000100:00100000:2.0:1788309533.157021:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210518912 00000100:00100000:2.0:1788309533.157062:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788309533.157142:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ec684a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875178210518784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309533.157232:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ec684a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875178210518784:12345-0@lo:400:kworker.0 Request processed in 161us (1976us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309533.157238:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788309533.157256:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788309533.157262:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6816d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875178210518912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309533.157308:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6816d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875178210518912:12345-0@lo:400:kworker.0 Request processed in 47us (1957us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309533.157315:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788309533.157360:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e6979180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875178210518912:0@lo:400:kworker.0 00000100:00100000:2.0:1788309533.157389:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e6979f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875178210518784:0@lo:400:kworker.0 00000100:00100000:2.0:1788309533.158161:0:10673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210519040 00000100:00100000:2.0:1788309533.158168:0:10673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210519040 00000100:00100000:2.0:1788309533.158210:0:10673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788309533.158218:0:10673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6817480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1875178210519040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309533.158269:0:10673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6817480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1875178210519040:12345-0@lo:400:kworker.0 Request processed in 52us (2860us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309533.158294:0:10673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:2.0:1788309533.158339:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8e697b100 x1875178210519040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788309549 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788309533.158352:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e697b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210519040:0@lo:400:kworker.0 00000100:00080000:2.0:1788309533.158903:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788309533.158909:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788309533.160569:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e697b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875178210519296:0@lo:400:kworker.0 00000100:00100000:1.0:1788309533.160658:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309533.162448:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788309533.162472:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e6979880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875178210519168:0@lo:400:kworker.0 00000100:00100000:2.0:1788309533.162552:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309533.162644:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210519296 00000100:00100000:2.0:1788309533.162663:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210519296 00000100:00100000:2.0:1788309533.162722:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788309533.162732:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6979f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875178210519296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309533.162792:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6979f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875178210519296:12345-0@lo:400:kworker.0 Request processed in 61us (2143us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309533.162799:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:2.0:1788309533.162820:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788309533.163527:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e697b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875178210519296:0@lo:400:kworker.0 00000100:00100000:1.0:1788309533.163559:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210519168 00000100:00100000:1.0:1788309533.163564:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210519168 00000100:00100000:1.0:1788309533.163622:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788309533.163630:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6814380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875178210519168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309533.163694:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6814380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875178210519168:12345-0@lo:400:kworker.0 Request processed in 65us (1142us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309533.163701:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788309533.163753:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e6979880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875178210519168:0@lo:400:kworker.0 00000100:00080000:2.0:1788309533.163938:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788309533.165414:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:3301:x1875178210518656:12345-0@lo:400:kworker.0 Request processed in 11634us (11935us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309533.165429:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1788309533.171269:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e697a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3301:1875178210518656:0@lo:400:kworker.0 00000040:00080000:2.0:1788309533.281342:0:11678:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788309533.415233:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788309533.642845:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309533.642893:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309533.642933:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309533.642961:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309533.643061:0:10673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192658560 00000100:00100000:1.0:1788309533.643073:0:10673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192658560 00000100:00100000:1.0:1788309533.643171:0:10673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 64 00000100:00100000:1.0:1788309533.643183:0:10673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecdc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+5:2351:x1875178192658560:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788309533.643270:0:10673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecdc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+5:2351:x1875178192658560:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 88us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309533.643311:0:10673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 64 00000100:00080000:3.0:1788309533.643388:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788309533.643715:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192658432 00000100:00100000:2.0:1788309533.643720:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192658432 00000100:00100000:2.0:1788309533.643773:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192658688 00000100:00100000:2.0:1788309533.643777:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192658688 00000100:00100000:2.0:1788309533.643801:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 114 00000100:00100000:2.0:1788309533.643808:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecdc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+5:2351:x1875178192658432:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:2.0:1788309533.643846:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecdc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+5:2351:x1875178192658432:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 39us (912us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309533.643854:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 114 00000100:00100000:2.0:1788309533.643868:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 115 00000100:00100000:2.0:1788309533.643875:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecdc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ea7f0717-c12d-4408-bdfd-5a035f695b73+5:2351:x1875178192658688:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:2.0:1788309533.643912:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecdc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ea7f0717-c12d-4408-bdfd-5a035f695b73+5:2351:x1875178192658688:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 25us (938us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309533.643920:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 115 00000100:00080000:3.0:1788309533.643994:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788309533.644194:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192658304 00000100:00100000:0.0:1788309533.644199:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192658304 00000100:00100000:0.0:1788309533.644237:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 280 00000100:00100000:0.0:1788309533.644244:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8351692-8d1a-4b41-bdaf-bf179786ff59+13:2351:x1875178192658304:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788309533.644274:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8351692-8d1a-4b41-bdaf-bf179786ff59+13:2351:x1875178192658304:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 31us (1443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309533.644312:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 280 00000100:00100000:1.0:1788309533.667411:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210519424:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788309533.667515:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309533.668004:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210519424 00000100:00100000:0.0:1788309533.668014:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210519424 00000100:00100000:0.0:1788309533.668072:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788309533.668083:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6979880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210519424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788309533.668219:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788309533.668314:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6979880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210519424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 233us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309533.668322:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788309533.668413:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210519424:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788309534.180707:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788309534.180733:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e697b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210519552:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788309534.180811:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309534.181264:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210519552 00000100:00100000:1.0:1788309534.181274:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210519552 00000100:00100000:1.0:1788309534.182434:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788309534.182450:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8eff0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875178210519552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788309534.182499:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1788309534.182590:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8eff0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875178210519552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 144us (1779us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309534.182597:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:0.0:1788309534.182679:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8e697b100 x1875178210519552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788309550 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788309534.182705:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e697b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210519552:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788309534.432522:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309535.457323:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309536.480779:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309537.505451:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788309538.273270:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875178210519808:0@lo:400:kworker.0 00000100:00100000:0.0:1788309538.273392:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309538.273459:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875178210520320:0@lo:400:kworker.0 00000100:00100000:0.0:1788309538.273488:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309538.273519:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788309538.273524:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875178210519936:0@lo:400:kworker.0 00000100:00100000:0.0:1788309538.273564:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309538.273601:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210519808 00000100:00100000:0.0:1788309538.273609:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210519808 00000100:00100000:0.0:1788309538.273656:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210519936 00000100:00100000:0.0:1788309538.273673:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210519936 00000100:00100000:0.0:1788309538.273707:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788309538.273717:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875178210519808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309538.273769:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875178210519808:12345-0@lo:400:kworker.0 Request processed in 54us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309538.273776:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788309538.273794:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788309538.273800:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffca9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875178210519936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309538.273832:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffca9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875178210519936:12345-0@lo:400:kworker.0 Request processed in 33us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309538.273838:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788309538.273857:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210520320 00000100:00100000:0.0:1788309538.273860:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210520320 00000100:00100000:0.0:1788309538.273898:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788309538.273905:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffca9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875178210520320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309538.273934:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffca9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875178210520320:12345-0@lo:400:kworker.0 Request processed in 30us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309538.273940:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788309538.273983:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875178210519936:0@lo:400:kworker.0 00000100:00100000:0.0:1788309538.273996:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875178210519808:0@lo:400:kworker.0 00000100:00100000:0.0:1788309538.274004:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875178210520320:0@lo:400:kworker.0 00000100:00080000:3.0:1788309538.274096:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788309538.274101:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788309538.274113:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3301:1875178210519680:0@lo:400:kworker.0 00000100:00100000:3.0:1788309538.274150:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309538.274182:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875178210520192:0@lo:400:kworker.0 00000100:00100000:3.0:1788309538.274218:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309538.274240:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788309538.274245:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210520064:0@lo:400:kworker.0 00000100:00100000:3.0:1788309538.274267:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309538.274311:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210520192 00000100:00100000:3.0:1788309538.274315:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210520192 00000100:00100000:3.0:1788309538.274344:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788309538.274350:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c958c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875178210520192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309538.274383:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c958c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875178210520192:12345-0@lo:400:kworker.0 Request processed in 32us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309538.274389:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:3.0:1788309538.274409:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788309538.274423:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875178210520192:0@lo:400:kworker.0 00000100:00100000:0.0:1788309538.274770:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210519680 00000100:00100000:0.0:1788309538.274775:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210519680 00000100:00100000:2.0:1788309538.274907:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210520064 00000100:00100000:2.0:1788309538.274912:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210520064 00000100:00100000:2.0:1788309538.274947:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788309538.274955:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c958e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875178210520064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309538.275000:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c958e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875178210520064:12345-0@lo:400:kworker.0 Request processed in 46us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309538.275006:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:2.0:1788309538.275371:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788309538.275527:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8eff0c000 x1875178210520064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788309554 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788309538.275687:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1788309538.275697:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:3301:x1875178210519680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309538.275752:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:3301:x1875178210519680:12345-0@lo:400:kworker.0 Request processed in 57us (1602us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309538.275758:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1788309538.276155:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210520064:0@lo:400:kworker.0 00000100:00100000:2.0:1788309538.276170:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3301:1875178210519680:0@lo:400:kworker.0 00010000:00010000:1.0:1788309538.528490:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788309538.757709:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309538.757925:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192658816 00000100:00100000:0.0:1788309538.757937:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192658816 00000100:00100000:0.0:1788309538.758000:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 282 00000100:00100000:0.0:1788309538.758011:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8351692-8d1a-4b41-bdaf-bf179786ff59+13:2351:x1875178192658816:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788309538.758095:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8351692-8d1a-4b41-bdaf-bf179786ff59+13:2351:x1875178192658816:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 86us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309538.758103:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 282 00000100:00100000:0.0:1788309538.763786:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309538.764468:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192658944 00000100:00100000:1.0:1788309538.764480:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192658944 00000100:00100000:1.0:1788309538.764594:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 119 00000100:00100000:1.0:1788309538.764606:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffca8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+5:2351:x1875178192658944:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788309538.764705:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffca8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+5:2351:x1875178192658944:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 101us (932us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309538.764713:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 119 00000100:00080000:2.0:1788309538.764789:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788309538.772670:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309538.772727:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309538.772827:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192659200 00000100:00100000:0.0:1788309538.772834:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192659072 00000100:00100000:3.0:1788309538.772847:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192659200 00000100:00100000:0.0:1788309538.772847:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192659072 00000100:00100000:0.0:1788309538.772943:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 19 00000100:00100000:0.0:1788309538.772955:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecdadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+5:2349:x1875178192659072:12345-192.168.202.55@tcp:9:kworker.0 00000020:00000080:0.0:1788309538.772987:0:6680:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x63a04852f46287dc 00000100:00080000:0.0:1788309538.772996:0:6680:0:(import.c:65:import_set_state_nolock()) ffff97c8f519f800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788309538.773047:0:6680:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:3.0:1788309538.773074:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 120 00000100:00100000:3.0:1788309538.773091:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecf16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ea7f0717-c12d-4408-bdfd-5a035f695b73+5:2351:x1875178192659200:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788309538.773195:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecf16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ea7f0717-c12d-4408-bdfd-5a035f695b73+5:2351:x1875178192659200:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 109us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309538.773205:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 120 00000100:00100000:0.0:1788309538.773430:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecdadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+2:2349:x1875178192659072:12345-192.168.202.55@tcp:9:kworker.0 Request processed in 475us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309538.773439:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 19 00010000:00010000:0.0:1788309538.773464:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788309538.773586:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788309538.773591:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788309538.785225:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffcab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210520448:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788309538.785318:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309538.785501:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210520448 00000100:00100000:0.0:1788309538.785510:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210520448 00000100:00100000:0.0:1788309538.785571:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788309538.785582:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6979180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210520448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788309538.785628:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788309538.785680:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6979180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210520448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309538.785686:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788309538.785784:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffcab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210520448:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788309539.297056:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e697b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210520576:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788309539.297143:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309539.297641:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210520576 00000100:00100000:0.0:1788309539.297651:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210520576 00000100:00100000:0.0:1788309539.297715:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788309539.297726:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecf16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875178210520576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788309539.297764:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1788309539.297828:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecf16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875178210520576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309539.297836:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:2.0:1788309539.297973:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8e697b100 x1875178210520576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788309555 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788309539.297998:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e697b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210520576:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788309539.553349:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309540.577543:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788309541.404483:0:7639:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 86451057-f8bb-4d7c-a7c2-5c834b43e3d3 00000020:00000080:0.0:1788309541.404492:0:7639:0:(genops.c:885:class_export_put()) final put ffff97c8f5199800/86451057-f8bb-4d7c-a7c2-5c834b43e3d3 00000020:00000080:2.0:1788309541.404593:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff97c8f5199800/86451057-f8bb-4d7c-a7c2-5c834b43e3d3 for lustre-OST0001 00000020:00000080:2.0:1788309541.404668:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97c8f519f800 for lustre-OST0001 00010000:00010000:0.0:1788309541.600587:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309542.625469:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788309543.398098:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecf16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3301:1875178210520704:0@lo:400:kworker.0 00000100:00100000:3.0:1788309543.398192:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309543.398522:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788309543.398539:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecfd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875178210520832:0@lo:400:kworker.0 00000100:00100000:2.0:1788309543.398573:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309543.398610:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210520832 00000100:00100000:2.0:1788309543.398619:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210520832 00000100:00100000:2.0:1788309543.398671:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788309543.398682:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecfd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875178210520832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309543.398737:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecfd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875178210520832:12345-0@lo:400:kworker.0 Request processed in 57us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309543.398745:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788309543.398790:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecfd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875178210520832:0@lo:400:kworker.0 00000100:00100000:2.0:1788309543.398857:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecfd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875178210520960:0@lo:400:kworker.0 00000100:00100000:2.0:1788309543.398883:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309543.398963:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecfd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210521088:0@lo:400:kworker.0 00000100:00100000:1.0:1788309543.399008:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309543.399045:0:10673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210521088 00000100:00100000:1.0:1788309543.399049:0:10673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210521088 00000100:00100000:1.0:1788309543.399112:0:10673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788309543.399121:0:10673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e697a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1875178210521088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309543.399164:0:10673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e697a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1875178210521088:12345-0@lo:400:kworker.0 Request processed in 45us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309543.399170:0:10673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:1.0:1788309543.399207:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8ecfd3b80 x1875178210521088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788309559 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788309543.399218:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecfd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210521088:0@lo:400:kworker.0 00000100:00100000:1.0:1788309543.399477:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210520704 00000100:00100000:1.0:1788309543.399483:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210520704 00000100:00100000:1.0:1788309543.399526:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1788309543.399535:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:3301:x1875178210520704:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788309543.399772:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788309543.399804:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788309543.399813:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecfd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875178210521216:0@lo:400:kworker.0 00000100:00100000:2.0:1788309543.399859:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309543.399917:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788309543.399925:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecfd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210521344:0@lo:400:kworker.0 00000100:00100000:2.0:1788309543.399953:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309543.399982:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210521344 00000100:00100000:2.0:1788309543.399986:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210521344 00000100:00100000:2.0:1788309543.400028:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788309543.400037:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecfd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210521344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309543.400075:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecfd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210521344:12345-0@lo:400:kworker.0 Request processed in 40us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309543.400081:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:2.0:1788309543.400196:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788309543.400221:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecfd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210521344:0@lo:400:kworker.0 00000100:00100000:1.0:1788309543.401981:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:3301:x1875178210520704:12345-0@lo:400:kworker.0 Request processed in 2438us (3779us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309543.401995:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1788309543.402420:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecf16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3301:1875178210520704:0@lo:400:kworker.0 00000100:00100000:3.0:1788309543.402915:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210520960 00000100:00100000:3.0:1788309543.402922:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210520960 00000100:00100000:3.0:1788309543.402980:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210521216 00000100:00100000:3.0:1788309543.402984:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210521216 00000100:00100000:3.0:1788309543.403009:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788309543.403018:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecfd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875178210520960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309543.403181:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecfd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875178210520960:12345-0@lo:400:kworker.0 Request processed in 163us (4296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309543.403188:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788309543.403208:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788309543.403214:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecfd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875178210521216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309543.403250:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecfd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875178210521216:12345-0@lo:400:kworker.0 Request processed in 37us (3391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309543.403256:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788309543.403321:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecfd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875178210520960:0@lo:400:kworker.0 00000100:00100000:3.0:1788309543.403366:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecfd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875178210521216:0@lo:400:kworker.0 00000100:00080000:1.0:1788309543.403958:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:0.0:1788309543.521158:0:11678:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788309543.650333:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788309543.880576:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309543.880655:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309543.880699:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309543.880771:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192659328 00000100:00100000:1.0:1788309543.880798:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192659328 00000100:00100000:1.0:1788309543.880871:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 284 00000100:00100000:1.0:1788309543.880882:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8351692-8d1a-4b41-bdaf-bf179786ff59+13:2351:x1875178192659328:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788309543.880967:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8351692-8d1a-4b41-bdaf-bf179786ff59+13:2351:x1875178192659328:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 87us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309543.880975:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 284 00000100:00100000:0.0:1788309543.886044:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192659456 00000100:00100000:0.0:1788309543.886062:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192659456 00000100:00100000:0.0:1788309543.886161:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192659584 00000100:00100000:0.0:1788309543.886166:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192659584 00000100:00100000:2.0:1788309543.886183:0:8305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 124 00000100:00100000:2.0:1788309543.886199:0:8305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c958dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+5:2351:x1875178192659456:12345-192.168.202.55@tcp:400:kworker.0 00000100:00080000:1.0:1788309543.886244:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788309543.886320:0:8305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c958dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+5:2351:x1875178192659456:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 125us (5759us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309543.887117:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 125 00000100:00100000:0.0:1788309543.887128:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c958d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ea7f0717-c12d-4408-bdfd-5a035f695b73+5:2351:x1875178192659584:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788309543.887173:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c958d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ea7f0717-c12d-4408-bdfd-5a035f695b73+5:2351:x1875178192659584:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 48us (6474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309543.887197:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 125 00000100:00100000:2.0:1788309543.892204:0:8305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 124 00000100:00100000:3.0:1788309543.904740:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffcab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210521472:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788309543.904817:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309543.905058:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210521472 00000100:00100000:0.0:1788309543.905067:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210521472 00000100:00100000:0.0:1788309543.905121:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788309543.905131:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c958ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210521472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788309543.905170:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788309543.905227:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c958ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210521472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309543.905234:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788309543.905360:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffcab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210521472:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788309544.419785:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e697b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210521600:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788309544.419888:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309544.420065:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210521600 00000100:00100000:1.0:1788309544.420076:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210521600 00000100:00100000:1.0:1788309544.420146:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788309544.420159:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c958d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875178210521600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788309544.420209:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1788309544.420309:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c958d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875178210521600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309544.420318:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:3.0:1788309544.421153:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8e697b100 x1875178210521600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788309560 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788309544.421212:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e697b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210521600:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788309544.672731:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788309545.175950:0:11842:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 20:39:03 (1788309543) 00010000:00010000:0.0:1788309545.697126:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788309546.569544:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309546.571661:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192659712 00000100:00100000:2.0:1788309546.571682:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192659712 00000100:00080000:1.0:1788309546.571908:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788309546.571973:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 32 00000100:00100000:2.0:1788309546.571991:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c958df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+5:10216:x1875178192659712:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788309546.572020:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309546.572051:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9600/0x63a04852f46288a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146a9d7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309546.572148:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f46288ae lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309546.572165:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f46288ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309546.572182:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f46288ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788309546.572626:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1788309546.572632:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1788309546.572747:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f46288ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309546.572788:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9600/0x63a04852f46288a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a9d7 expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309546.572812:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f46288ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a9d7 expref: 6 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309546.572823:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c8d83f4e00) 00010000:00010000:2.0:1788309546.572827:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788309546.572831:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8e26d8800, rc 0) 00000100:00100000:2.0:1788309546.573000:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c958df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:10216:x1875178192659712:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 1015us (3469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309546.573015:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 32 00000100:00100000:1.0:1788309546.592814:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309546.595795:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192659840 00000100:00100000:3.0:1788309546.595822:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192659840 00000100:00100000:3.0:1788309546.596018:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 33 00000100:00100000:3.0:1788309546.596033:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e697b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:10217:x1875178192659840:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788309546.596063:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309546.596093:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f46288b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146a9de expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309546.596194:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f46288bc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309546.596213:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f46288bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309546.596482:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f46288bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309546.596502:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f46288c3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309546.596510:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f46288c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309546.596518:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f46288c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309546.597062:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73efe00/0x63a04852f46288ca lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309546.597075:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73efe00/0x63a04852f46288ca lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309546.597083:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73efe00/0x63a04852f46288ca lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788309546.597765:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1788309546.597773:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1788309546.597869:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73efe00/0x63a04852f46288ca lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309546.597888:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f46288bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309546.597896:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f46288bc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309546.597916:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f46288bc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309546.597922:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8d73eee00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:3.0:1788309546.597927:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f46288bc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309546.597936:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f46288bc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309546.597952:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c8d83f4e00) 00010000:00010000:3.0:1788309546.597955:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788309546.597960:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f46288bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309546.597967:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f46288bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309546.597984:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f46288c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309546.597991:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f46288c3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309546.597997:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f46288c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309546.598002:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8d73ee400 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:3.0:1788309546.598005:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f46288c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309546.598021:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f46288c3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309546.598031:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff97c8c3d81900) 00010000:00010000:3.0:1788309546.598033:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788309546.598036:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f46288c3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309546.598043:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f46288c3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309546.599329:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f46288b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a9de expref: 8 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309546.599368:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73efe00/0x63a04852f46288ca lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a9de expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309546.599378:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff97c8c3d81e00) 00010000:00010000:3.0:1788309546.599382:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788309546.599385:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8d73efe00, rc 0) 00000100:00100000:3.0:1788309546.599512:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e697b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+7:10217:x1875178192659840:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 3481us (6712us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309546.599523:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 33 00000100:00100000:1.0:1788309546.622240:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309546.622399:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192660096 00000100:00100000:0.0:1788309546.622417:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192660096 00000100:00100000:0.0:1788309546.622648:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 34 00000100:00100000:0.0:1788309546.622661:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6b4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+7:10217:x1875178192660096:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788309546.622690:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788309546.622721:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f200/0x63a04852f46288d1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146a9e5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309546.622827:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f800/0x63a04852f46288d8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309546.622845:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f800/0x63a04852f46288d8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309546.622860:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f800/0x63a04852f46288d8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309546.623062:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2fe00/0x63a04852f46288df lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309546.623100:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2fe00/0x63a04852f46288df lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309546.623113:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2fe00/0x63a04852f46288df lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309546.625065:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ea00/0x63a04852f46288e6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309546.625088:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ea00/0x63a04852f46288e6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309546.625101:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ea00/0x63a04852f46288e6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788309546.625115:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1788309546.627935:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f800/0x63a04852f46288d8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309546.628028:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f800/0x63a04852f46288d8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309546.628036:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f800/0x63a04852f46288d8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309546.628043:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8ecf2f800 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:0.0:1788309546.628048:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f800/0x63a04852f46288d8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309546.628057:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f800/0x63a04852f46288d8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309546.628092:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff97c8c3d81e00) 00010000:00010000:0.0:1788309546.628095:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788309546.628099:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f800/0x63a04852f46288d8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309546.628106:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f800/0x63a04852f46288d8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309546.628123:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2fe00/0x63a04852f46288df lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309546.628130:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2fe00/0x63a04852f46288df lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309546.628136:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2fe00/0x63a04852f46288df lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309546.628141:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8ecf2fe00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:0.0:1788309546.628144:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2fe00/0x63a04852f46288df lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309546.628150:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2fe00/0x63a04852f46288df lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309546.628157:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff97c8c2ab9000) 00010000:00010000:0.0:1788309546.628159:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788309546.628162:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2fe00/0x63a04852f46288df lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309546.628167:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2fe00/0x63a04852f46288df lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309546.628907:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f200/0x63a04852f46288d1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a9e5 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309546.628929:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ea00/0x63a04852f46288e6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a9e5 expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309546.628936:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97c8c2ab9600) 00010000:00010000:0.0:1788309546.629014:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788309546.629018:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8ecf2ea00, rc 0) 00000100:00100000:0.0:1788309546.629098:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6b4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+9:10217:x1875178192660096:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 6437us (6869us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788309546.629107:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 34 00000100:00100000:2.0:1788309546.644141:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309546.646962:0:8305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192660224 00000100:00100000:3.0:1788309546.646978:0:8305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192660224 00000100:00100000:3.0:1788309546.648961:0:8305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 35 00000100:00100000:3.0:1788309546.648987:0:8305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecfd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+9:10217:x1875178192660224:12345-192.168.202.55@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788309546.649156:0:8305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecfd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+9:10217:x1875178192660224:12345-192.168.202.55@tcp:59:lhsmtool_posix.0 Request processed in 181us (5027us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309546.649164:0:8305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 35 00010000:00010000:1.0:1788309546.724553:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788309547.619439:0:11678:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788309547.744433:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788309548.515111:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffcab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3301:1875178210521728:0@lo:400:kworker.0 00000100:00100000:0.0:1788309548.515145:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210522112:0@lo:400:kworker.0 00000100:00100000:3.0:1788309548.515195:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309548.515494:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309548.515550:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788309548.515557:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875178210522240:0@lo:400:kworker.0 00000100:00100000:0.0:1788309548.515586:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309548.515613:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffcab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875178210521856:0@lo:400:kworker.0 00000100:00100000:0.0:1788309548.515652:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309548.515675:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875178210522368:0@lo:400:kworker.0 00000100:00100000:0.0:1788309548.515696:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309548.515714:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788309548.515719:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875178210521984:0@lo:400:kworker.0 00000100:00100000:0.0:1788309548.515742:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309548.515773:0:10673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210522112 00000100:00100000:0.0:1788309548.515787:0:10673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210522112 00000100:00100000:0.0:1788309548.515840:0:10673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210522368 00000100:00100000:0.0:1788309548.515843:0:10673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210522368 00000100:00100000:0.0:1788309548.515868:0:10673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788309548.515878:0:10673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8eff0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1875178210522112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309548.515936:0:10673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8eff0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1875178210522112:12345-0@lo:400:kworker.0 Request processed in 59us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309548.515944:0:10673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788309548.515961:0:10673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788309548.515968:0:10673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f5244700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1875178210522368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309548.516001:0:10673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f5244700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1875178210522368:12345-0@lo:400:kworker.0 Request processed in 34us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309548.516007:0:10673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788309548.516027:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210522240 00000100:00100000:0.0:1788309548.516032:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210522240 00000100:00100000:0.0:1788309548.516058:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210521856 00000100:00100000:0.0:1788309548.516061:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210521856 00000100:00100000:0.0:1788309548.516073:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210521984 00000100:00100000:0.0:1788309548.516075:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210521984 00000100:00100000:0.0:1788309548.516090:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788309548.516096:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8eff0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875178210522240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309548.516126:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8eff0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875178210522240:12345-0@lo:400:kworker.0 Request processed in 30us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309548.516132:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788309548.516145:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788309548.516151:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f5245500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875178210521856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309548.516176:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f5245500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875178210521856:12345-0@lo:400:kworker.0 Request processed in 26us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309548.516191:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788309548.516205:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788309548.516211:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f5247b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875178210521984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309548.516236:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f5247b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875178210521984:12345-0@lo:400:kworker.0 Request processed in 26us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309548.516241:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:0.0:1788309548.516267:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788309548.516272:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788309548.516297:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788309548.516338:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875178210521984:0@lo:400:kworker.0 00000100:00100000:0.0:1788309548.516350:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffcab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875178210521856:0@lo:400:kworker.0 00000100:00100000:0.0:1788309548.516359:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875178210522368:0@lo:400:kworker.0 00000100:00100000:0.0:1788309548.516569:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875178210522240:0@lo:400:kworker.0 00010000:00080000:0.0:1788309548.516581:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8eff0c000 x1875178210522112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788309564 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788309548.516591:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210522112:0@lo:400:kworker.0 00000100:00100000:2.0:1788309548.523548:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210521728 00000100:00100000:2.0:1788309548.523567:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210521728 00000100:00100000:2.0:1788309548.523625:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1788309548.523635:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:3301:x1875178210521728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309548.523725:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:3301:x1875178210521728:12345-0@lo:400:kworker.0 Request processed in 91us (8530us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309548.523732:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1788309548.526856:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffcab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3301:1875178210521728:0@lo:400:kworker.0 00000100:00100000:1.0:1788309548.602713:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309548.602776:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192660352 00000100:00100000:2.0:1788309548.602789:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192660352 00000100:00100000:2.0:1788309548.602875:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 36 00000100:00100000:2.0:1788309548.602887:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6b4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+9:10259:x1875178192660352:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:2.0:1788309548.602910:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309548.602934:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f46288f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146a9ec expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309548.602997:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8a00/0x63a04852f46288fb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309548.603010:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8a00/0x63a04852f46288fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309548.603023:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8a00/0x63a04852f46288fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309548.603038:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628902 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309548.603057:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628902 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309548.603064:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628902 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309548.603351:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8a00/0x63a04852f46288fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309548.603360:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8a00/0x63a04852f46288fb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309548.603366:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8a00/0x63a04852f46288fb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309548.603372:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d8a00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309548.603377:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8a00/0x63a04852f46288fb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309548.603384:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8a00/0x63a04852f46288fb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309548.603396:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c8d83f4e00) 00010000:00010000:2.0:1788309548.603399:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788309548.603403:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8a00/0x63a04852f46288fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309548.603409:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8a00/0x63a04852f46288fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309548.603420:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628902 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309548.603433:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628902 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309548.603449:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628902 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309548.603454:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d9c00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309548.603457:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628902 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309548.603463:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628902 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309548.603472:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff97c8d83f4000) 00010000:00010000:2.0:1788309548.603474:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788309548.603477:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628902 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309548.603484:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628902 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309548.603517:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f46288f4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a9ec expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309548.603527:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c8d83f4e00) 00010000:00010000:2.0:1788309548.603529:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788309548.603533:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f46288f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a9ec expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309548.603541:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8e26d8000, rc 0) 00000100:00100000:2.0:1788309548.603598:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6b4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+9:10259:x1875178192660352:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 713us (896us total) trans 0 rc 301/301 00000100:00100000:2.0:1788309548.603606:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 36 00000100:00080000:1.0:1788309548.603910:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788309548.619426:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309548.619570:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192660608 00000100:00100000:2.0:1788309548.619582:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192660608 00000100:00100000:2.0:1788309548.619646:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 37 00000100:00100000:2.0:1788309548.619658:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c89fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+9:10259:x1875178192660608:12345-192.168.202.55@tcp:36:lfs.0 00010000:00010000:2.0:1788309548.619721:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788309548.619759:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f46288ae lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a9d7 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309548.619783:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c8d83f4e00) 00010000:00010000:2.0:1788309548.619792:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788309548.620054:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4628909 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309548.620079:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4628909 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309548.620089:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4628909 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309548.620108:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4628910 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309548.620114:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4628910 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309548.620121:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4628910 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788309548.623016:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1788309548.623035:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4628909 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309548.623045:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4628909 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309548.623052:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4628909 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309548.623058:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d8600 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309548.623062:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4628909 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309548.623069:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4628909 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309548.623088:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c8d83f4800) 00010000:00010000:2.0:1788309548.623091:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788309548.623113:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4628909 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309548.623120:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4628909 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788309548.623141:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a984086e reply state 00000000b7fbcbff transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4628910 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309548.623152:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788309548.623306:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c89fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+10:10259:x1875178192660608:12345-192.168.202.55@tcp:36:lfs.0 Request processed in 3647us (3886us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788309548.623328:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 37 00010000:00010000:3.0:1788309548.642716:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4628910 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309548.642801:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4628910 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309548.642811:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4628910 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309548.642817:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d8c00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:3.0:1788309548.642823:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4628910 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309548.642831:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4628910 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309548.642850:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff97c8d83f4300) 00010000:00010000:3.0:1788309548.642853:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788309548.642858:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4628910 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309548.642863:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4628910 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309548.710682:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309548.710797:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192660736 00000100:00100000:3.0:1788309548.710809:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192660736 00000100:00100000:3.0:1788309548.710873:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 38 00000100:00100000:3.0:1788309548.710884:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c89f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+9:10267:x1875178192660736:12345-192.168.202.55@tcp:101:lctl.0 00010000:00010000:3.0:1788309548.710913:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309548.710936:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f4628917 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146a9f3 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309548.711001:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f462891e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309548.711015:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f462891e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309548.711026:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f462891e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788309548.711082:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1788309548.711086:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1788309548.711127:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f462891e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309548.711152:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f4628917 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a9f3 expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309548.711170:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f462891e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a9f3 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309548.711178:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c8c3d81800) 00010000:00010000:3.0:1788309548.711188:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788309548.711191:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8d73ef800, rc 0) 00000100:00100000:3.0:1788309548.711257:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c89f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+10:10267:x1875178192660736:12345-192.168.202.55@tcp:101:lctl.0 Request processed in 373us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309548.711264:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 38 00010000:00010000:1.0:1788309548.769130:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788309548.786376:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309548.786526:0:8305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192660864 00000100:00100000:1.0:1788309548.786535:0:8305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192660864 00000100:00100000:1.0:1788309548.786623:0:8305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 39 00000100:00100000:1.0:1788309548.786634:0:8305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecfd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+10:10273:x1875178192660864:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:1.0:1788309548.786655:0:8305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788309548.786674:0:8305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628925 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146a9fa expref: -99 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309548.786742:0:8305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548c00/0x63a04852f462892c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309548.786758:0:8305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548c00/0x63a04852f462892c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309548.786770:0:8305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548c00/0x63a04852f462892c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309548.786784:0:8305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548600/0x63a04852f4628933 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309548.786803:0:8305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548600/0x63a04852f4628933 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309548.786810:0:8305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548600/0x63a04852f4628933 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309548.786917:0:8305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549600/0x63a04852f462893a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309548.786943:0:8305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549600/0x63a04852f462893a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309548.786951:0:8305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549600/0x63a04852f462893a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788309548.786985:0:8305:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:1.0:1788309548.786990:0:8305:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788309548.787036:0:8305:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549600/0x63a04852f462893a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309548.787049:0:8305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548c00/0x63a04852f462892c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309548.787056:0:8305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548c00/0x63a04852f462892c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309548.787062:0:8305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548c00/0x63a04852f462892c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309548.787068:0:8305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8f5548c00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:1.0:1788309548.787072:0:8305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548c00/0x63a04852f462892c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309548.787080:0:8305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548c00/0x63a04852f462892c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309548.787092:0:8305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c8c3d81800) 00010000:00010000:1.0:1788309548.787095:0:8305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788309548.787100:0:8305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548c00/0x63a04852f462892c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309548.787117:0:8305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548c00/0x63a04852f462892c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309548.787130:0:8305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548600/0x63a04852f4628933 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309548.787137:0:8305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548600/0x63a04852f4628933 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309548.787143:0:8305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548600/0x63a04852f4628933 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309548.787148:0:8305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8f5548600 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:1.0:1788309548.787150:0:8305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548600/0x63a04852f4628933 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309548.787156:0:8305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548600/0x63a04852f4628933 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309548.787310:0:8305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff97c8d832ff00) 00010000:00010000:1.0:1788309548.787313:0:8305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788309548.787317:0:8305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548600/0x63a04852f4628933 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309548.787323:0:8305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548600/0x63a04852f4628933 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309548.787354:0:8305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628925 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a9fa expref: 12 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309548.787367:0:8305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549600/0x63a04852f462893a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a9fa expref: 11 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309548.787380:0:8305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97c8d832f400) 00010000:00010000:1.0:1788309548.787383:0:8305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788309548.787385:0:8305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8f5549600, rc 0) 00000100:00100000:1.0:1788309548.787516:0:8305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecfd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+11:10273:x1875178192660864:12345-192.168.202.55@tcp:101:bash.0 Request processed in 883us (1149us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309548.787524:0:8305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 39 00000100:00100000:1.0:1788309548.791572:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309548.791719:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192661120 00000100:00100000:2.0:1788309548.791730:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192661120 00000100:00100000:2.0:1788309548.791831:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 40 00000100:00100000:2.0:1788309548.791844:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c89f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+11:10273:x1875178192661120:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:2.0:1788309548.791866:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309548.791887:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4628941 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146aa01 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309548.792025:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4628948 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309548.792040:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4628948 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309548.792052:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4628948 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309548.792067:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f462894f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309548.792075:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f462894f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309548.792082:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f462894f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788309548.792738:0:5837:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:2.0:1788309548.792904:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628956 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309548.792921:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628956 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309548.792931:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628956 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309548.792968:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4628948 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309548.792976:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4628948 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309548.792983:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4628948 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309548.792988:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d8800 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309548.792992:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4628948 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309548.792998:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4628948 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309548.793010:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97c8d832f400) 00010000:00010000:2.0:1788309548.793012:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788309548.793017:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4628948 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309548.793022:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4628948 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788309548.793036:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ed3b46e0 reply state 00000000527508a7 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f462894f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309548.793051:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788309548.793082:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4628941 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa01 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309548.793097:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628956 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa01 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309548.793105:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c8d83f4e00) 00010000:00010000:2.0:1788309548.793107:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788309548.793110:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8e26d9c00, rc 0) 00000100:00100000:2.0:1788309548.793183:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c89f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+14:10273:x1875178192661120:12345-192.168.202.55@tcp:101:bash.0 Request processed in 1343us (1624us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1788309548.793191:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 40 00000100:00100000:1.0:1788309548.799143:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309548.799315:0:10673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192661248 00000100:00100000:0.0:1788309548.799325:0:10673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192661248 00000100:00100000:0.0:1788309548.799361:0:10673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 20 00000100:00100000:0.0:1788309548.799370:0:10673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e667d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2349:x1875178192661248:12345-192.168.202.55@tcp:8:bash.0 00010000:00080000:0.0:1788309548.799402:0:10673:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 86451057-f8bb-4d7c-a7c2-5c834b43e3d3@192.168.202.55@tcp t0 exp 0000000000000000 cur 311 last 0 00000020:00000080:0.0:1788309548.799432:0:10673:0:(genops.c:1385:class_connect()) connect: client 86451057-f8bb-4d7c-a7c2-5c834b43e3d3, cookie 0x63a04852f4628964 00002000:00100000:0.0:1788309548.799459:0:10673:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 86451057-f8bb-4d7c-a7c2-5c834b43e3d3/ffff97c8ecdb9000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392d ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788309548.799498:0:10673:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788309548.799735:0:10673:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788309548.799773:0:10673:0:(import.c:65:import_set_state_nolock()) ffff97c8ecdba800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788309548.799859:0:10673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e667d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:2349:x1875178192661248:12345-192.168.202.55@tcp:8:bash.0 Request processed in 487us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309548.799868:0:10673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 20 00010000:00010000:3.0:1788309548.800613:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f462894f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309548.800626:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f462894f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309548.800634:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f462894f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309548.800640:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d8000 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:3.0:1788309548.800645:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f462894f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309548.800653:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f462894f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309548.800669:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97c8d83f4800) 00010000:00010000:3.0:1788309548.800672:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788309548.800677:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f462894f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309548.800683:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f462894f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309548.802960:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309548.803045:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192661376 00000100:00100000:2.0:1788309548.803056:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192661376 00000100:00100000:2.0:1788309548.803186:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 21 00000100:00100000:2.0:1788309548.803199:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f5244000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:0:x1875178192661376:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:2.0:1788309548.803219:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309548.803245:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bda9db79/0x63a04852f462896b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146aa08 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788309548.803311:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788309548.803332:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=311s v=(0 0) 00010000:00010000:2.0:1788309548.803338:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788309548.803348:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bda9db79/0x63a04852f462896b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa08 expref: 7 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309548.803392:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bda9db79/0x63a04852f462896b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa08 expref: 7 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309548.803408:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8e26d8600, rc 0) 00000100:00100000:2.0:1788309548.803484:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f5244000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+7:0:x1875178192661376:12345-192.168.202.55@tcp:101:bash.0 Request processed in 288us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309548.803491:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 21 00000100:00080000:1.0:1788309548.804060:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788309548.806906:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309548.807010:0:10673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192661504 00000100:00100000:0.0:1788309548.807021:0:10673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192661504 00000100:00100000:0.0:1788309548.807080:0:10673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 22 00000100:00100000:0.0:1788309548.807091:0:10673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecfd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+7:10273:x1875178192661504:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:0.0:1788309548.807107:0:10673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788309548.807126:0:10673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004adb66c4/0x63a04852f4628972 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146aa0f expref: -99 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309548.807156:0:10673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bda9db79/0x63a04852f462896b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa08 expref: 8 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309548.807165:0:10673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788309548.807169:0:10673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788309548.807175:0:10673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004adb66c4/0x63a04852f4628972 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa0f expref: 8 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309548.807212:0:10673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bda9db79/0x63a04852f462896b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa08 expref: 8 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309548.807246:0:10673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bda9db79/0x63a04852f462896b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa08 expref: 8 pid: 6680 timeout: 411 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309548.807261:0:10673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8f5246300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10673:1875178210522496:192.168.202.55@tcp:104: 00000100:00100000:0.0:1788309548.807516:0:10673:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c3634d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788309548.810538:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309548.811197:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192661632 00000100:00100000:2.0:1788309548.811207:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192661632 00010000:00010000:2.0:1788309548.811252:0:8447:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bda9db79/0x63a04852f462896b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa08 expref: 9 pid: 6680 timeout: 411 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309548.811326:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 35 00000100:00100000:2.0:1788309548.811338:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e667ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+9:2350:x1875178192661632:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788309548.811351:0:8447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788309548.811377:0:8447:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bda9db79/0x63a04852f462896b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa08 expref: 9 pid: 6680 timeout: 411 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309548.811391:0:8447:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bda9db79/0x63a04852f462896b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa08 expref: 9 pid: 6680 timeout: 411 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309548.811415:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788309548.811420:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788309548.811453:0:8447:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004adb66c4/0x63a04852f4628972 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa0f expref: 9 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309548.811461:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004adb66c4/0x63a04852f4628972 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa0f expref: 9 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309548.811491:0:8447:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000004adb66c4/0x63a04852f4628972 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa0f expref: 9 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309548.811501:0:8447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecfd1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8447:1875178210522624:192.168.202.55@tcp:105: 00000100:00100000:2.0:1788309548.811570:0:8447:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c826d300 going to sleep for 11 seconds 00010000:00010000:0.0:1788309548.812683:0:10673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bda9db79/0x63a04852f462896b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa08 expref: 9 pid: 6680 timeout: 411 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309548.812707:0:10673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8f5246300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10673:1875178210522496:192.168.202.55@tcp:104: 00010000:00010000:0.0:1788309548.812734:0:10673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004adb66c4/0x63a04852f4628972 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa0f expref: 8 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309548.812746:0:10673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8ecf2e200, rc 0) 00000100:00100000:0.0:1788309548.812797:0:10673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecfd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+8:10273:x1875178192661504:12345-192.168.202.55@tcp:101:bash.0 Request processed in 5706us (5903us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309548.812804:0:10673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 22 00000100:00100000:1.0:1788309548.816080:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309548.816629:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192661888 00000100:00100000:0.0:1788309548.816639:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192661888 00000100:00100000:0.0:1788309548.816689:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 6 00000100:00100000:0.0:1788309548.816700:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e667e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+13:10273:x1875178192661888:12345-192.168.202.55@tcp:35:bash.0 00000100:00100000:2.0:1788309548.816702:0:8447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecfd1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8447:1875178210522624:192.168.202.55@tcp:105: 00010000:00010000:2.0:1788309548.816726:0:8447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788309548.816921:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e667ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+7:2350:x1875178192661632:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 5584us (6390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309548.816930:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 35 00000100:00100000:0.0:1788309548.817021:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e667e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+14:10273:x1875178192661888:12345-192.168.202.55@tcp:35:bash.0 Request processed in 322us (950us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1788309548.817028:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 6 00000100:00100000:2.0:1788309548.895858:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309548.895936:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192662144 00000100:00100000:0.0:1788309548.895947:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192662144 00000100:00100000:0.0:1788309548.896007:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 41 00000100:00100000:0.0:1788309548.896019:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecfd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+14:10283:x1875178192662144:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:0.0:1788309548.896047:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788309548.896068:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f400/0x63a04852f4628979 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146aa16 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788309548.896179:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1788309548.896334:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f400/0x63a04852f4628979 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa16 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309548.896359:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c8c3d81800) 00010000:00010000:0.0:1788309548.896363:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788309548.896375:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f400/0x63a04852f4628979 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa16 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309548.896399:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8ecf2f400, rc 0) 00000100:00100000:0.0:1788309548.896471:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecfd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+15:10283:x1875178192662144:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 454us (624us total) trans 4294967313 rc 301/301 00000100:00100000:0.0:1788309548.896479:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 41 00000100:00100000:3.0:1788309548.900655:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309548.901380:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192662400 00000100:00100000:0.0:1788309548.901391:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192662400 00000100:00100000:0.0:1788309548.901457:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 7 00000100:00100000:0.0:1788309548.901471:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c958ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+15:10283:x1875178192662400:12345-192.168.202.55@tcp:35:lfs.0 00000100:00100000:0.0:1788309548.901741:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c958ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+16:10283:x1875178192662400:12345-192.168.202.55@tcp:35:lfs.0 Request processed in 273us (1099us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1788309548.901767:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 7 00000100:00100000:3.0:1788309548.962781:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309548.962938:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192662528 00000100:00100000:0.0:1788309548.962949:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192662528 00000100:00100000:0.0:1788309548.963008:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 42 00000100:00100000:0.0:1788309548.963019:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c958f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+16:10289:x1875178192662528:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:0.0:1788309548.963044:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788309548.963067:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f400/0x63a04852f4628987 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146aa1d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309548.963134:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ee00/0x63a04852f462898e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309548.963148:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ee00/0x63a04852f462898e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309548.963172:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ee00/0x63a04852f462898e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788309548.963228:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:0.0:1788309548.963243:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1788309548.963269:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ee00/0x63a04852f462898e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309548.963336:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f400/0x63a04852f4628987 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa1d expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309548.963359:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ee00/0x63a04852f462898e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa1d expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309548.963381:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97c8d832f400) 00010000:00010000:0.0:1788309548.963384:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788309548.963388:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8ecf2ee00, rc 0) 00000100:00100000:0.0:1788309548.963461:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c958f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+17:10289:x1875178192662528:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 443us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309548.963469:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 42 00000100:00100000:2.0:1788309548.968725:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309548.968842:0:8305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192662784 00000100:00100000:1.0:1788309548.968853:0:8305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192662784 00000100:00100000:1.0:1788309548.968921:0:8305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 43 00000100:00100000:1.0:1788309548.968932:0:8305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecfd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+17:10289:x1875178192662784:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:1.0:1788309548.968953:0:8305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788309548.968973:0:8305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628995 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146aa24 expref: -99 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309548.969065:0:8305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548600/0x63a04852f462899c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309548.969080:0:8305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548600/0x63a04852f462899c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309548.969091:0:8305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548600/0x63a04852f462899c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788309548.969120:0:8305:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788309548.969256:0:8305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628995 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa24 expref: 20 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309548.969273:0:8305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548600/0x63a04852f462899c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa24 expref: 19 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309548.969321:0:8305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c8d83f4e00) 00010000:00010000:1.0:1788309548.969324:0:8305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788309548.969327:0:8305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8f5548600, rc 0) 00000100:00100000:1.0:1788309548.969396:0:8305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecfd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+19:10289:x1875178192662784:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 465us (683us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1788309548.969404:0:8305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 43 00000100:00100000:3.0:1788309548.974822:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309548.975645:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192663040 00000100:00100000:2.0:1788309548.975655:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192663040 00000100:00100000:2.0:1788309548.975728:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 44 00000100:00100000:2.0:1788309548.975739:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c958ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+19:10289:x1875178192663040:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:2.0:1788309548.975764:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309548.975785:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9600/0x63a04852f46289aa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146aa2b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309548.977069:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f46289b1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309548.977090:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f46289b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309548.977101:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f46289b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788309548.977117:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788309548.977269:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9600/0x63a04852f46289aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa2b expref: 22 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309548.977308:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f46289b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa2b expref: 21 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309548.977318:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c8d83f4e00) 00010000:00010000:2.0:1788309548.977321:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788309548.977325:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8e26d9a00, rc 0) 00000100:00100000:2.0:1788309548.977405:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c958ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+21:10289:x1875178192663040:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 1667us (2592us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1788309548.977413:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 44 00000100:00100000:3.0:1788309548.979076:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309548.979164:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192663168 00000100:00100000:2.0:1788309548.979173:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192663168 00000100:00100000:2.0:1788309548.979232:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 2 00000100:00100000:2.0:1788309548.979242:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c958e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+21:2353:x1875178192663168:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788309548.979255:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788309548.979325:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548600/0x63a04852f462899c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa24 expref: 21 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309548.979343:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c8d83f4e00) 00010000:00010000:2.0:1788309548.979347:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788309548.979391:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c958e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+20:2353:x1875178192663168:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 150us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309548.979398:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 2 00000100:00100000:0.0:1788309548.985168:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309548.985254:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192663296 00000100:00100000:2.0:1788309548.985264:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192663296 00000100:00100000:2.0:1788309548.985339:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 23 00000100:00100000:2.0:1788309548.985349:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f5246300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+7:2351:x1875178192663296:12345-192.168.202.55@tcp:1:lfs.0 00010000:00010000:2.0:1788309548.985397:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008be65c54/0x63a04852f46289bf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309548.985418:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004adb66c4/0x63a04852f4628972 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa0f expref: 7 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309548.985426:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788309548.985430:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788309548.985449:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be65c54/0x63a04852f46289bf lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309548.985494:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004adb66c4/0x63a04852f4628972 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa0f expref: 7 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309548.985508:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004adb66c4/0x63a04852f4628972 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa0f expref: 7 pid: 10673 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309548.985536:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecfd3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1875178210522752:192.168.202.55@tcp:104: 00000100:00100000:2.0:1788309548.985637:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c826d300 going to sleep for 11 seconds 00000100:00100000:2.0:1788309548.988087:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecfd3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1875178210522752:192.168.202.55@tcp:104: 00010000:00010000:2.0:1788309548.988119:0:6680:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008be65c54/0x63a04852f46289bf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309548.990211:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309548.990312:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192663424 00000100:00100000:2.0:1788309548.990320:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192663424 00002000:00100000:2.0:1788309548.990361:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff97c8f5245c00 x1875178192663424/t0(0) o4->86451057-f8bb-4d7c-a7c2-5c834b43e3d3@192.168.202.55@tcp:704/0 lens 504/0 e 0 to 0 dl 1788309559 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788309548.990371:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97c8f5245c00 with x1875178192663424 ext(0->12) 00010000:00010000:2.0:1788309548.990380:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000004adb66c4/0x63a04852f4628972 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa0f expref: 8 pid: 10673 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309548.990397:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000004adb66c4/0x63a04852f4628972 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa0f expref: 8 pid: 10673 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788309548.990405:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff97c8f5245c00 00000100:00100000:2.0:1788309548.990452:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 0 00000100:00100000:2.0:1788309548.990462:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f5245c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+8:2351:x1875178192663424:12345-192.168.202.55@tcp:4:lfs.0 00000100:00100000:1.0:1788309548.997073:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309548.997117:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309548.997232:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192663680 00000100:00100000:0.0:1788309548.997242:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192663680 00000100:00100000:0.0:1788309548.997339:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 129 00000100:00100000:0.0:1788309548.997350:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e667ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ea7f0717-c12d-4408-bdfd-5a035f695b73+5:2352:x1875178192663680:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788309548.997425:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e667ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ea7f0717-c12d-4408-bdfd-5a035f695b73+5:2352:x1875178192663680:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 76us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309548.997466:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 129 00000100:00080000:1.0:1788309548.997868:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788309548.997976:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192663552 00000100:00100000:3.0:1788309548.997982:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192663552 00000100:00100000:3.0:1788309548.998021:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 286 00000100:00100000:3.0:1788309548.998030:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8351692-8d1a-4b41-bdaf-bf179786ff59+13:2352:x1875178192663552:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788309548.998064:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8351692-8d1a-4b41-bdaf-bf179786ff59+13:2352:x1875178192663552:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 35us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309548.998071:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 286 00000100:00100000:3.0:1788309549.024550:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8f5245880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210522880:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788309549.024639:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309549.024810:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210522880 00000100:00100000:1.0:1788309549.024817:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210522880 00000100:00100000:1.0:1788309549.024867:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788309549.024874:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c958f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210522880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788309549.024903:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788309549.025369:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c958f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210522880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 493us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309549.025428:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788309549.025600:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8f5245880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210522880:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1788309549.037889:0:6706:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 86451057-f8bb-4d7c-a7c2-5c834b43e3d3 00000100:00100000:2.0:1788309549.040217:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f5245c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+9:2351:x1875178192663424:12345-192.168.202.55@tcp:4:lfs.0 Request processed in 49743us (49999us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788309549.040233:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 0 00002000:00100000:2.0:1788309549.040262:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff97c8f5245c00 x1875178192663424/t4294967299(0) o4->86451057-f8bb-4d7c-a7c2-5c834b43e3d3@192.168.202.55@tcp:704/0 lens 504/448 e 0 to 0 dl 1788309559 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788309549.040274:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97c8f5245c00 with x1875178192663424 ext(0->12) 00010000:00010000:2.0:1788309549.040326:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000004adb66c4/0x63a04852f4628972 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa0f expref: 9 pid: 10673 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.040355:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000004adb66c4/0x63a04852f4628972 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa0f expref: 9 pid: 10673 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788309549.040364:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff97c8f5245c00 00000100:00100000:1.0:1788309549.044375:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309549.044772:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192663808 00000100:00100000:2.0:1788309549.044794:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192663808 00010000:00010000:2.0:1788309549.044840:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004adb66c4/0x63a04852f4628972 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa0f expref: 9 pid: 10673 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309549.044889:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 36 00000100:00100000:2.0:1788309549.044900:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e667f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+9:2351:x1875178192663808:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788309549.044915:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788309549.044936:0:5823:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788309549.044938:0:5823:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788309548 00002000:00010000:2.0:1788309549.044941:0:5823:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788309548 00002000:00010000:2.0:1788309549.044943:0:5823:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788309548 00010000:00010000:2.0:1788309549.044951:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004adb66c4/0x63a04852f4628972 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa0f expref: 9 pid: 10673 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.044965:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004adb66c4/0x63a04852f4628972 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa0f expref: 9 pid: 10673 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.044996:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004adb66c4/0x63a04852f4628972 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa0f expref: 9 pid: 10673 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.045016:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788309549.045022:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788309549.045027:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008be65c54/0x63a04852f46289bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.045037:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be65c54/0x63a04852f46289bf lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.045073:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788309549.045297:0:6680:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008be65c54/0x63a04852f46289bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309549.045309:0:6680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be65c54/0x63a04852f46289bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309549.045333:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008be65c54/0x63a04852f46289bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309549.045342:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008be65c54/0x63a04852f46289bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309549.045367:0:6680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008be65c54/0x63a04852f46289bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309549.045374:0:6680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d9600 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:0.0:1788309549.045386:0:6680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008be65c54/0x63a04852f46289bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309549.045396:0:6680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008be65c54/0x63a04852f46289bf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309549.045410:0:6680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008be65c54/0x63a04852f46289bf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309549.045417:0:6680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be65c54/0x63a04852f46289bf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309549.045934:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e667f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+8:2351:x1875178192663808:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 1032us (1566us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309549.045942:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 36 00000100:00100000:0.0:1788309549.045996:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f5246300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+7:2351:x1875178192663296:12345-192.168.202.55@tcp:1:lfs.0 Request processed in 60648us (60838us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309549.046005:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 23 00000100:00100000:0.0:1788309549.050785:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309549.051777:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192664064 00000100:00100000:1.0:1788309549.051854:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192664064 00000100:00100000:1.0:1788309549.051959:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 8 00000100:00100000:1.0:1788309549.051972:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f5244a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+20:10289:x1875178192664064:12345-192.168.202.55@tcp:35:lfs.0 00000004:00010000:1.0:1788309549.052044:0:5841:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f46289b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa2b expref: 20 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788309549.052364:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:1.0:1788309549.052448:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:1.0:1788309549.053967:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:1.0:1788309549.054048:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f46289c6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309549.054068:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628956 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa01 expref: 24 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309549.054077:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f46289c6 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309549.054117:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628956 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa01 expref: 24 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309549.054135:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628956 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa01 expref: 24 pid: 5837 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309549.054150:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e667d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5841:1875178210523008:192.168.202.55@tcp:104: 00000100:00100000:1.0:1788309549.055002:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8ea245240 going to sleep for 11 seconds 00000100:00100000:0.0:1788309549.064212:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309549.064338:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e667d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5841:1875178210523008:192.168.202.55@tcp:104: 00010000:00010000:1.0:1788309549.064398:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f46289c6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309549.064850:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192664192 00000100:00100000:2.0:1788309549.064857:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192664192 00010000:00010000:2.0:1788309549.064894:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628956 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa01 expref: 25 pid: 5837 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309549.064933:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 37 00000100:00100000:2.0:1788309549.064942:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f5245180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+25:2350:x1875178192664192:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788309549.064957:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788309549.064963:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628956 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa01 expref: 25 pid: 5837 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.064987:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628956 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa01 expref: 25 pid: 5837 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.065010:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628956 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa01 expref: 25 pid: 5837 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.065028:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c8d83f4e00) 00010000:00010000:2.0:1788309549.065033:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f46289c6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.065041:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f46289c6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.065049:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f46289c6 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.065077:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788309549.065130:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f5245180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+24:2350:x1875178192664192:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 188us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309549.065137:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 37 00010000:00010000:0.0:1788309549.065310:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f46289c6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309549.065318:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f46289c6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788309549.065483:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1788309549.065709:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:0.0:1788309549.065830:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8f5245f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5841:1875178210523136:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788309549.065882:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309549.065912:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c36346c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788309549.066713:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210523136 00000100:00100000:2.0:1788309549.066721:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210523136 00000100:00100000:2.0:1788309549.066764:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788309549.066773:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f5244e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5841:x1875178210523136:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788309549.066857:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f5244e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5841:x1875178210523136:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 86us (974us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309549.066864:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788309549.066910:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8f5245f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5841:1875178210523136:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788309549.069868:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1788309549.069967:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecfd3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5841:1875178210523264:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788309549.070039:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309549.070126:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c948f780 going to sleep for 11 seconds 00000100:00100000:3.0:1788309549.070772:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210523264 00000100:00100000:3.0:1788309549.070782:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210523264 00000100:00100000:3.0:1788309549.070915:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788309549.070924:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecfd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5841:x1875178210523264:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788309549.071163:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecfd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5841:x1875178210523264:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 239us (1123us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788309549.071170:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788309549.071249:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecfd3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5841:1875178210523264:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788309549.071339:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:2.0:1788309549.071404:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f46289c6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.071415:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f46289c6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.071421:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f46289c6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.071427:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8f5548000 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309549.071432:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f46289c6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.071451:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f46289c6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.071468:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c8d83f4e00) 00010000:00010000:2.0:1788309549.071471:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788309549.071486:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f46289c6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.071493:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f46289c6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788309549.071702:0:5841:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788309549.071936:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1788309549.071949:0:5841:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 311822670836ns, next at 312822667979ns, rc = 0 00000001:00080000:2.0:1788309549.071956:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:2.0:1788309549.071992:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c8d83f4e00) 00010000:00010000:2.0:1788309549.071995:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788309549.072002:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f46289b1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa2b expref: 28 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309549.072111:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f5244a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+27:10289:x1875178192664064:12345-192.168.202.55@tcp:35:lfs.0 Request processed in 20142us (21635us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1788309549.072119:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 8 00000020:00080000:2.0:1788309549.072122:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788309549.077055:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309549.077148:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192664320 00000100:00100000:3.0:1788309549.077158:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192664320 00000100:00100000:3.0:1788309549.077255:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 45 00000100:00100000:3.0:1788309549.077266:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f5247100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+27:10289:x1875178192664320:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:3.0:1788309549.077330:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309549.077362:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f46289cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146aa32 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309549.077464:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f46289cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa32 expref: 28 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309549.077480:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f46289cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa32 expref: 28 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309549.077505:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c8c3d81900) 00010000:00010000:3.0:1788309549.077508:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788309549.077512:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8d73ee400, rc 0) 00000100:00100000:3.0:1788309549.077589:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f5247100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+28:10289:x1875178192664320:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 325us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309549.077596:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 45 00000100:00100000:1.0:1788309549.082860:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309549.082942:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192664576 00000100:00100000:0.0:1788309549.082952:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192664576 00000100:00100000:0.0:1788309549.083009:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 9 00000100:00100000:0.0:1788309549.083021:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c7000450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+28:10289:x1875178192664576:12345-192.168.202.55@tcp:35:lfs.0 00000100:00100000:0.0:1788309549.083262:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c7000450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+29:10289:x1875178192664576:12345-192.168.202.55@tcp:35:lfs.0 Request processed in 243us (413us total) trans 4294967326 rc 0/0 00000100:00100000:0.0:1788309549.083270:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 9 00000100:00100000:0.0:1788309549.187866:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309549.188050:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192664832 00000100:00100000:2.0:1788309549.188061:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192664832 00000100:00100000:2.0:1788309549.188127:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 46 00000100:00100000:2.0:1788309549.188138:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f5244a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+29:10300:x1875178192664832:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:2.0:1788309549.188163:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309549.188183:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f46289d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146aa39 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788309549.188327:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1788309549.188455:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f46289d4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa39 expref: 31 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.188470:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c8c3d81800) 00010000:00010000:2.0:1788309549.188500:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788309549.188506:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f46289d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa39 expref: 31 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.188522:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8e26d9a00, rc 0) 00000100:00100000:2.0:1788309549.188597:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f5244a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+30:10300:x1875178192664832:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 461us (742us total) trans 4294967327 rc 301/301 00000100:00100000:2.0:1788309549.188605:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 46 00000100:00100000:3.0:1788309549.192324:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309549.192407:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192664960 00000100:00100000:2.0:1788309549.192416:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192664960 00000100:00100000:2.0:1788309549.192489:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 47 00000100:00100000:2.0:1788309549.192500:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c958c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+30:10300:x1875178192664960:12345-192.168.202.55@tcp:34:lfs.0 00010000:00010000:2.0:1788309549.192585:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f46289e2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.192602:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f46289e2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.192613:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f46289e2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.192631:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f46289e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.192638:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f46289e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.192644:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f46289e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.192739:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f46289f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.192759:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f46289f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.192766:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f46289f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788309549.192814:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f46289f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.192826:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f46289e2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.192833:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f46289e2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.192840:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f46289e2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.192845:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d9c00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309549.192850:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f46289e2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.192857:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f46289e2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.192868:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97c8d832f400) 00010000:00010000:2.0:1788309549.192871:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788309549.192875:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f46289e2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.192881:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f46289e2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.192901:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f46289e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.192907:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f46289e9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.192913:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f46289e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.192918:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d8e00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309549.192920:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f46289e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.192926:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f46289e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.192932:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97c8d83f4e00) 00010000:00010000:2.0:1788309549.192934:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788309549.192937:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f46289e9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.192942:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f46289e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.192954:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f46289f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.192960:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f46289f0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.192965:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f46289f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.192973:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d8800 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309549.192976:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f46289f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.192982:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f46289f0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.192988:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c8c3d81900) 00010000:00010000:2.0:1788309549.192990:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788309549.192993:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f46289f0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.192998:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f46289f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309549.193062:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c958c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+30:10300:x1875178192664960:12345-192.168.202.55@tcp:34:lfs.0 Request processed in 563us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309549.193068:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 47 00000100:00100000:3.0:1788309549.197208:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309549.197331:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192665216 00000100:00100000:0.0:1788309549.197342:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192665216 00000100:00100000:0.0:1788309549.197394:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 10 00000100:00100000:0.0:1788309549.197405:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c958ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+30:10300:x1875178192665216:12345-192.168.202.55@tcp:35:lfs.0 00000100:00100000:0.0:1788309549.197989:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c958ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+31:10300:x1875178192665216:12345-192.168.202.55@tcp:35:lfs.0 Request processed in 584us (788us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1788309549.197999:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 10 00000100:00100000:0.0:1788309549.236337:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309549.236427:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192665472 00000100:00100000:2.0:1788309549.236447:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192665472 00000100:00100000:2.0:1788309549.236502:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 48 00000100:00100000:2.0:1788309549.236511:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f5246d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+31:10303:x1875178192665472:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:2.0:1788309549.236535:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309549.236561:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f46289f7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146aa40 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.236638:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f46289fe lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.236670:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f46289fe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.236681:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f46289fe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.236697:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628a05 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.236704:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628a05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.236711:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628a05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.237007:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4628a0c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.237017:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4628a0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.237024:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4628a0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788309549.237034:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788309549.237145:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f46289fe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.237153:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f46289fe lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.237159:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f46289fe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.237172:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d8e00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309549.237177:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f46289fe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.237184:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f46289fe lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.237196:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97c8d832f400) 00010000:00010000:2.0:1788309549.237199:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788309549.237203:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f46289fe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.237208:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f46289fe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.237223:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628a05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.237228:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628a05 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.237234:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628a05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.237239:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d9c00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309549.237242:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628a05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.237248:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628a05 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.237267:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97c8d83f4e00) 00010000:00010000:2.0:1788309549.237269:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788309549.237272:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628a05 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.237353:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628a05 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.237405:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f46289f7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa40 expref: 34 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.237419:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4628a0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa40 expref: 33 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.237426:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c8c3d81900) 00010000:00010000:2.0:1788309549.237428:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788309549.237442:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8e26d9a00, rc 0) 00000100:00100000:2.0:1788309549.237512:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f5246d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+33:10303:x1875178192665472:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 1000us (1184us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1788309549.237519:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 48 00000100:00100000:1.0:1788309549.243322:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309549.243360:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192665600 00000100:00100000:2.0:1788309549.243371:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192665600 00000100:00100000:2.0:1788309549.243428:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 49 00000100:00100000:2.0:1788309549.243585:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e667d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+33:10303:x1875178192665600:12345-192.168.202.55@tcp:54:lfs.0 00010000:00010000:2.0:1788309549.243654:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628a1a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.243671:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628a1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.243693:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628a1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.243716:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628a1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.243720:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628a1a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.243725:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628a1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.243728:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d8e00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309549.243731:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628a1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.243736:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628a1a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.243744:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c8c3d81900) 00010000:00010000:2.0:1788309549.243746:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788309549.243749:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628a1a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.243752:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628a1a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309549.243829:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e667d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+33:10303:x1875178192665600:12345-192.168.202.55@tcp:54:lfs.0 Request processed in 249us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309549.243837:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 49 00000100:00100000:0.0:1788309549.246252:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309549.246339:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192665856 00000100:00100000:2.0:1788309549.246360:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192665856 00000100:00100000:2.0:1788309549.246406:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 11 00000100:00100000:2.0:1788309549.246417:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f5246680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+33:10303:x1875178192665856:12345-192.168.202.55@tcp:35:lfs.0 00000100:00100000:2.0:1788309549.246664:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f5246680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+34:10303:x1875178192665856:12345-192.168.202.55@tcp:35:lfs.0 Request processed in 248us (418us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1788309549.246672:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 11 00000100:00100000:2.0:1788309549.537706:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e667f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210523392:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788309549.537772:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309549.537904:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210523392 00000100:00100000:1.0:1788309549.537915:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210523392 00000100:00100000:1.0:1788309549.537975:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788309549.537988:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecfd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1875178210523392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788309549.538009:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3858759680 avail 3856662528 00000100:00100000:1.0:1788309549.538054:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecfd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1875178210523392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309549.538060:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788309549.538095:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e667f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210523392:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788309549.543998:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309549.544077:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192666112 00000100:00100000:2.0:1788309549.544089:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192666112 00000100:00100000:2.0:1788309549.544153:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 50 00000100:00100000:2.0:1788309549.544164:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f5247480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+34:10334:x1875178192666112:12345-192.168.202.55@tcp:101:cat.0 00010000:00010000:2.0:1788309549.544188:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309549.544207:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628a21 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146aa47 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.544334:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4628a28 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.544348:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4628a28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.544361:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4628a28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788309549.544371:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788309549.544520:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628a21 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa47 expref: 37 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.544568:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4628a28 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa47 expref: 36 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.544577:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c8c3d81900) 00010000:00010000:2.0:1788309549.544580:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788309549.544583:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8e26d8800, rc 0) 00000100:00100000:2.0:1788309549.544632:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f5247480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+36:10334:x1875178192666112:12345-192.168.202.55@tcp:101:cat.0 Request processed in 470us (645us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1788309549.544639:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 50 00000100:00100000:1.0:1788309549.551773:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309549.552234:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192666240 00000100:00100000:2.0:1788309549.552245:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192666240 00000100:00100000:2.0:1788309549.552352:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 3 00000100:00100000:2.0:1788309549.552364:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6b29850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+36:2353:x1875178192666240:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788309549.552380:0:8447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788309549.552405:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4628a28 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa47 expref: 36 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.552424:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c8c3d81900) 00010000:00010000:2.0:1788309549.552439:0:8447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788309549.552492:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6b29850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+35:2353:x1875178192666240:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 131us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309549.552501:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 3 00000100:00100000:0.0:1788309549.553384:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309549.553493:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192666496 00000100:00100000:2.0:1788309549.553498:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192666496 00000100:00100000:2.0:1788309549.553530:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 12 00000100:00100000:2.0:1788309549.553545:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f5244380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+35:10334:x1875178192666496:12345-192.168.202.55@tcp:35:cat.0 00000100:00100000:2.0:1788309549.553857:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f5244380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+36:10334:x1875178192666496:12345-192.168.202.55@tcp:35:cat.0 Request processed in 312us (475us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1788309549.553865:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 12 00000100:00100000:0.0:1788309549.673775:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309549.674005:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192666752 00000100:00100000:3.0:1788309549.674016:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192666752 00000100:00100000:3.0:1788309549.674081:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 51 00000100:00100000:3.0:1788309549.674093:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f5246a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+36:10340:x1875178192666752:12345-192.168.202.55@tcp:101:dd.0 00010000:00010000:3.0:1788309549.674129:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309549.674133:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788309549.674160:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ee00/0x63a04852f462898e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa1d expref: 36 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309549.674180:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97c8d832f400) 00010000:00010000:3.0:1788309549.674185:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788309549.674197:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4628a36 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146aa4e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309549.674358:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f4628a3d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309549.674372:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4628a0c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa40 expref: 36 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309549.674380:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f4628a3d lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309549.674413:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4628a0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa40 expref: 36 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309549.674425:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4628a0c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa40 expref: 36 pid: 5838 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309549.674450:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8c958f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875178210523520:192.168.202.55@tcp:104: 00000100:00100000:3.0:1788309549.674553:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d120b300 going to sleep for 11 seconds 00000100:00100000:0.0:1788309549.680845:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309549.681140:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192666880 00000100:00100000:2.0:1788309549.681151:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192666880 00010000:00010000:2.0:1788309549.681191:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4628a0c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa40 expref: 37 pid: 5838 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309549.681235:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 38 00000100:00100000:2.0:1788309549.681245:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f5247800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+37:2351:x1875178192666880:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788309549.681261:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788309549.681267:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4628a0c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa40 expref: 37 pid: 5838 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.681306:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4628a0c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa40 expref: 37 pid: 5838 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.681329:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c8c3d81900) 00010000:00010000:2.0:1788309549.681334:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f4628a3d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.681344:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f4628a3d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.681352:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f4628a3d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.681385:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788309549.681452:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f5247800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+37:2351:x1875178192666880:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 208us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309549.681459:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 38 00010000:00010000:3.0:1788309549.681756:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4628a0c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa40 expref: 36 pid: 5838 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309549.681774:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8c958f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875178210523520:192.168.202.55@tcp:104: 00010000:00010000:3.0:1788309549.681803:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f4628a3d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309549.681812:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f4628a3d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309549.681829:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f4628a3d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788309549.681847:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788309549.682017:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4628a36 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa4e expref: 37 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309549.682031:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f4628a3d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa4e expref: 36 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309549.682039:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c8c3d81900) 00010000:00010000:3.0:1788309549.682042:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788309549.682044:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8d73ef200, rc 0) 00000100:00100000:3.0:1788309549.682071:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f5246a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+36:10340:x1875178192666752:12345-192.168.202.55@tcp:101:dd.0 Request processed in 7981us (8309us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1788309549.682078:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 51 00000100:00100000:3.0:1788309549.686881:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309549.687477:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192667136 00000100:00100000:2.0:1788309549.687490:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192667136 00000100:00100000:2.0:1788309549.687561:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 52 00000100:00100000:2.0:1788309549.687571:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c958f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+36:10340:x1875178192667136:12345-192.168.202.55@tcp:36:dd.0 00010000:00010000:2.0:1788309549.687824:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4628a4b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.687840:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4628a4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.687851:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4628a4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788309549.687893:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:2.0:1788309549.687913:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003042c739 reply state 0000000000cc9242 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4628a4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309549.687922:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788309549.688011:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c958f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+39:10340:x1875178192667136:12345-192.168.202.55@tcp:36:dd.0 Request processed in 440us (1552us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1788309549.688017:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 52 00000020:00080000:2.0:1788309549.688022:0:5838:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788309549.691252:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4628a4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309549.691268:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4628a4b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309549.691302:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4628a4b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309549.691309:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d8800 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:3.0:1788309549.691314:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4628a4b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309549.691335:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4628a4b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309549.691353:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c8c3d81900) 00010000:00010000:3.0:1788309549.691355:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788309549.691359:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4628a4b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309549.691365:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4628a4b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309549.792580:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788309549.968089:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309549.969376:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192667264 00000100:00100000:0.0:1788309549.969389:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192667264 00000100:00100000:0.0:1788309549.969484:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 53 00000100:00100000:0.0:1788309549.969495:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c958d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+38:10354:x1875178192667264:12345-192.168.202.55@tcp:101:stat.0 00010000:00010000:0.0:1788309549.969519:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788309549.969541:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2fc00/0x63a04852f4628a52 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146aa55 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309549.969611:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f600/0x63a04852f4628a59 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309549.969626:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f600/0x63a04852f4628a59 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309549.969637:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f600/0x63a04852f4628a59 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309549.969652:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e600/0x63a04852f4628a60 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309549.969659:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e600/0x63a04852f4628a60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309549.969665:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e600/0x63a04852f4628a60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309549.969760:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ee00/0x63a04852f4628a67 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309549.969803:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f4628a3d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa4e expref: 39 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309549.969811:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ee00/0x63a04852f4628a67 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309549.969845:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f4628a3d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa4e expref: 39 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309549.969858:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f4628a3d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa4e expref: 39 pid: 5839 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309549.969874:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8f5245180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1875178210523648:192.168.202.55@tcp:104: 00000100:00100000:0.0:1788309549.969980:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c3634780 going to sleep for 11 seconds 00000100:00100000:0.0:1788309549.973009:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309549.973062:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192667520 00000100:00100000:3.0:1788309549.973071:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192667520 00000100:00100000:3.0:1788309549.973132:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 13 00000100:00100000:3.0:1788309549.973143:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f5245f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+40:5589:x1875178192667520:12345-192.168.202.55@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788309549.973628:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f5245f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+41:5589:x1875178192667520:12345-192.168.202.55@tcp:35:ldlm_bl.0 Request processed in 485us (624us total) trans 4294967336 rc 0/0 00000100:00100000:3.0:1788309549.973637:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 13 00000100:00100000:1.0:1788309549.976345:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309549.976668:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192667648 00000100:00100000:3.0:1788309549.976677:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192667648 00010000:00010000:3.0:1788309549.976713:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f4628a3d lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa4e expref: 41 pid: 5839 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309549.976755:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 39 00000100:00100000:3.0:1788309549.976764:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e667f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+41:2350:x1875178192667648:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788309549.976786:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788309549.976805:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f4628a3d lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa4e expref: 41 pid: 5839 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309549.976819:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f4628a3d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa4e expref: 41 pid: 5839 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309549.976840:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c8c3d81900) 00010000:00010000:3.0:1788309549.976845:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ee00/0x63a04852f4628a67 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309549.976855:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ee00/0x63a04852f4628a67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309549.976862:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ee00/0x63a04852f4628a67 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309549.976881:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788309549.976937:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e667f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+41:2350:x1875178192667648:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 173us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309549.976944:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 39 00010000:00010000:2.0:1788309549.979623:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f4628a3d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa4e expref: 40 pid: 5839 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309549.979670:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8f5245180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1875178210523648:192.168.202.55@tcp:104: 00010000:00010000:2.0:1788309549.979697:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ee00/0x63a04852f4628a67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.979708:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ee00/0x63a04852f4628a67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.979714:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ee00/0x63a04852f4628a67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788309549.979762:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788309549.979766:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788309549.979819:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ee00/0x63a04852f4628a67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.979834:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ee00/0x63a04852f4628a67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.979843:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f600/0x63a04852f4628a59 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.979850:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f600/0x63a04852f4628a59 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.979858:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f600/0x63a04852f4628a59 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.979863:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8ecf2f600 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309549.979867:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f600/0x63a04852f4628a59 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.979883:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f600/0x63a04852f4628a59 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.979897:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97c8d832f400) 00010000:00010000:2.0:1788309549.979900:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788309549.979904:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f600/0x63a04852f4628a59 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.979910:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f600/0x63a04852f4628a59 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.979923:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e600/0x63a04852f4628a60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.979928:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e600/0x63a04852f4628a60 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.980824:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e600/0x63a04852f4628a60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.980830:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8ecf2e600 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309549.980833:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e600/0x63a04852f4628a60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.980840:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e600/0x63a04852f4628a60 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.980851:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97c8c2ab9300) 00010000:00010000:2.0:1788309549.980854:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788309549.980858:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e600/0x63a04852f4628a60 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.980879:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e600/0x63a04852f4628a60 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.980930:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2fc00/0x63a04852f4628a52 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa55 expref: 40 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.980946:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ee00/0x63a04852f4628a67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa55 expref: 39 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309549.980953:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c8c3d81900) 00010000:00010000:2.0:1788309549.980956:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788309549.980958:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8ecf2ee00, rc 0) 00000100:00100000:2.0:1788309549.981035:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c958d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+39:10354:x1875178192667264:12345-192.168.202.55@tcp:101:stat.0 Request processed in 11542us (12957us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309549.981043:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 53 00000100:00100000:1.0:1788309550.056824:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309550.056954:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192667904 00000100:00100000:2.0:1788309550.056966:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192667904 00000100:00100000:2.0:1788309550.057041:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 54 00000100:00100000:2.0:1788309550.057051:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e667ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+39:10360:x1875178192667904:12345-192.168.202.55@tcp:36:truncate.0 00010000:00010000:2.0:1788309550.057130:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788309550.057158:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ee00/0x63a04852f4628a67 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa55 expref: 39 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.057176:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c8c3d81900) 00010000:00010000:2.0:1788309550.057181:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788309550.057452:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628a6e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.057481:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628a6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.057493:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628a6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788309550.057551:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:2.0:1788309550.057577:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000008ca2262 reply state 000000003e007748 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628a6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309550.057586:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788309550.057704:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e667ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+41:10360:x1875178192667904:12345-192.168.202.55@tcp:36:truncate.0 Request processed in 653us (890us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1788309550.057711:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 54 00000020:00080000:2.0:1788309550.057717:0:5838:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:1.0:1788309550.057895:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788309550.060220:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628a6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309550.060237:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628a6e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309550.060245:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628a6e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309550.060251:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d8e00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:0.0:1788309550.060256:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628a6e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309550.060263:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628a6e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309550.060339:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c8c3d81900) 00010000:00010000:0.0:1788309550.060342:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788309550.060347:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628a6e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309550.060353:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628a6e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309550.217528:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309550.217634:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192668032 00000100:00100000:3.0:1788309550.217644:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192668032 00000100:00100000:3.0:1788309550.217711:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 55 00000100:00100000:3.0:1788309550.217723:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e667e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+40:10374:x1875178192668032:12345-192.168.202.55@tcp:101:stat.0 00010000:00010000:3.0:1788309550.217751:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309550.217772:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628a75 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146aa5c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309550.217847:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4628a7c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309550.217874:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4628a7c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309550.217885:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4628a7c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309550.217899:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628a83 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309550.217906:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628a83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309550.217912:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628a83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309550.218016:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4628a8a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309550.218024:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4628a8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309550.218030:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4628a8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788309550.218062:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1788309550.218066:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788309550.218084:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4628a8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309550.218096:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4628a8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309550.218115:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4628a7c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309550.218121:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4628a7c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309550.218128:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4628a7c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309550.218133:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8c153a000 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:3.0:1788309550.218138:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4628a7c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309550.218145:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4628a7c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309550.218156:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97c8d832f400) 00010000:00010000:3.0:1788309550.218159:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788309550.218162:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4628a7c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309550.218168:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4628a7c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309550.218181:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628a83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309550.218187:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628a83 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309550.218193:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628a83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309550.218202:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8c153ac00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:3.0:1788309550.218205:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628a83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309550.218211:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628a83 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309550.218218:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97c8c3d81b00) 00010000:00010000:3.0:1788309550.218220:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788309550.218222:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628a83 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309550.218227:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628a83 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309550.218267:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628a75 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa5c expref: 42 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309550.218327:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4628a8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa5c expref: 41 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309550.218334:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c8c3d81900) 00010000:00010000:3.0:1788309550.218336:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788309550.218338:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8c153bc00, rc 0) 00000100:00100000:3.0:1788309550.218404:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e667e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+41:10374:x1875178192668032:12345-192.168.202.55@tcp:101:stat.0 Request processed in 682us (888us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309550.218411:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 55 00000100:00100000:3.0:1788309550.343401:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309550.343578:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192668288 00000100:00100000:2.0:1788309550.343588:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192668288 00000100:00100000:2.0:1788309550.343649:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 56 00000100:00100000:2.0:1788309550.343660:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c958c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+41:10384:x1875178192668288:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:2.0:1788309550.343681:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309550.343700:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628a91 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146aa63 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788309550.343827:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1788309550.344125:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628a91 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa63 expref: 43 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.344141:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c8c3d81800) 00010000:00010000:2.0:1788309550.344152:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788309550.344158:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628a91 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa63 expref: 43 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.344174:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8e26d8000, rc 0) 00000100:00100000:2.0:1788309550.344342:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c958c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+42:10384:x1875178192668288:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 683us (952us total) trans 4294967339 rc 301/301 00000100:00100000:2.0:1788309550.344351:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 56 00000100:00100000:2.0:1788309550.352395:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309550.352751:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192668544 00000100:00100000:3.0:1788309550.352761:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192668544 00000100:00100000:3.0:1788309550.352833:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 14 00000100:00100000:3.0:1788309550.352845:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecfd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+42:10384:x1875178192668544:12345-192.168.202.55@tcp:35:lfs.0 00000100:00100000:3.0:1788309550.353409:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecfd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+43:10384:x1875178192668544:12345-192.168.202.55@tcp:35:lfs.0 Request processed in 563us (1023us total) trans 4294967340 rc 0/0 00000100:00100000:3.0:1788309550.353418:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 14 00000100:00100000:1.0:1788309550.442440:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309550.442540:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192668800 00000100:00100000:2.0:1788309550.442551:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192668800 00000100:00100000:2.0:1788309550.442624:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 57 00000100:00100000:2.0:1788309550.442635:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e667ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+43:10390:x1875178192668800:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:2.0:1788309550.442661:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309550.442682:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628a9f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146aa6a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.443038:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8a00/0x63a04852f4628aa6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.443056:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4628a8a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa5c expref: 44 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.443066:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8a00/0x63a04852f4628aa6 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.443104:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4628a8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa5c expref: 44 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.443201:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4628a8a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa5c expref: 44 pid: 5839 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309550.443216:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecfd0380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1875178210523776:192.168.202.55@tcp:104: 00000100:00100000:2.0:1788309550.443357:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8efc3fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788309550.450324:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309550.450488:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecfd0380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1875178210523776:192.168.202.55@tcp:104: 00010000:00010000:2.0:1788309550.450516:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8a00/0x63a04852f4628aa6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309550.454326:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192668928 00000100:00100000:3.0:1788309550.454341:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192668928 00010000:00010000:3.0:1788309550.454396:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4628a8a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa5c expref: 45 pid: 5839 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309550.454452:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 40 00000100:00100000:3.0:1788309550.454464:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e667f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+45:2350:x1875178192668928:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788309550.454481:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788309550.454489:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4628a8a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa5c expref: 45 pid: 5839 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309550.454503:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4628a8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa5c expref: 45 pid: 5839 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309550.454528:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4628a8a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa5c expref: 45 pid: 5839 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309550.454558:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c8c3d81900) 00010000:00010000:3.0:1788309550.454564:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8a00/0x63a04852f4628aa6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309550.454600:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8a00/0x63a04852f4628aa6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309550.454608:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8a00/0x63a04852f4628aa6 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309550.454641:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788309550.454713:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e667f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+44:2350:x1875178192668928:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 251us (4401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309550.454721:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 40 00010000:00010000:2.0:1788309550.455067:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8a00/0x63a04852f4628aa6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.455077:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8a00/0x63a04852f4628aa6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788309550.455098:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1788309550.455321:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628a9f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa6a expref: 45 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.455340:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8a00/0x63a04852f4628aa6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa6a expref: 44 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.455349:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c8c3d81900) 00010000:00010000:2.0:1788309550.455352:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788309550.455354:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8e26d8a00, rc 0) 00000100:00100000:2.0:1788309550.455400:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e667ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+44:10390:x1875178192668800:12345-192.168.202.55@tcp:101:bash.0 Request processed in 12767us (12981us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1788309550.455415:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 57 00000100:00100000:1.0:1788309550.459989:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309550.460191:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192669184 00000100:00100000:2.0:1788309550.460202:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192669184 00000100:00100000:2.0:1788309550.460263:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 58 00000100:00100000:2.0:1788309550.460305:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e667e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+44:10390:x1875178192669184:12345-192.168.202.55@tcp:36:bash.0 00010000:00010000:2.0:1788309550.460806:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4628ab4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.460825:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4628ab4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.460836:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4628ab4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788309550.460889:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:2.0:1788309550.460913:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000019d8bea2 reply state 00000000b5f1567a transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4628ab4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309550.460923:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788309550.461017:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e667e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+47:10390:x1875178192669184:12345-192.168.202.55@tcp:36:bash.0 Request processed in 743us (1037us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1788309550.461024:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 58 00000020:00080000:2.0:1788309550.461029:0:5838:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788309550.465988:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4628ab4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.466006:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4628ab4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.466013:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4628ab4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.466037:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d8c00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309550.466042:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4628ab4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.466050:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4628ab4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.466068:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c8c3d81900) 00010000:00010000:2.0:1788309550.466071:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788309550.466075:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4628ab4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.466081:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4628ab4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309550.469754:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309550.470085:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192669312 00000100:00100000:3.0:1788309550.470095:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192669312 00000100:00100000:3.0:1788309550.470160:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 59 00000100:00100000:3.0:1788309550.470171:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f5241180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+46:10390:x1875178192669312:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:3.0:1788309550.470197:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309550.470217:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4628abb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146aa71 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309550.470512:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628ac2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309550.470540:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8a00/0x63a04852f4628aa6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa6a expref: 47 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309550.470550:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628ac2 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309550.470590:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8a00/0x63a04852f4628aa6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa6a expref: 47 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309550.470615:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8a00/0x63a04852f4628aa6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa6a expref: 47 pid: 5837 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309550.470630:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8c958fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875178210523904:192.168.202.55@tcp:104: 00000100:00100000:3.0:1788309550.470762:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d120b240 going to sleep for 11 seconds 00000100:00100000:3.0:1788309550.473623:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309550.473720:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192669440 00000100:00100000:1.0:1788309550.473729:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192669440 00010000:00010000:1.0:1788309550.473764:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8a00/0x63a04852f4628aa6 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa6a expref: 48 pid: 5837 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309550.473818:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 41 00000100:00100000:1.0:1788309550.473825:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c958e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+48:2351:x1875178192669440:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788309550.473836:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788309550.473842:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8a00/0x63a04852f4628aa6 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa6a expref: 48 pid: 5837 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309550.473852:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8a00/0x63a04852f4628aa6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa6a expref: 48 pid: 5837 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309550.473871:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c8c3d81900) 00010000:00010000:1.0:1788309550.473875:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628ac2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309550.473882:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309550.473887:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628ac2 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309550.473902:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788309550.473950:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c958e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+48:2351:x1875178192669440:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 125us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309550.473957:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 41 00010000:00010000:0.0:1788309550.474446:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8a00/0x63a04852f4628aa6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa6a expref: 47 pid: 5837 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309550.474466:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8c958fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875178210523904:192.168.202.55@tcp:104: 00010000:00010000:0.0:1788309550.474487:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309550.474494:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309550.474498:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788309550.474548:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788309550.474553:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788309550.474573:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309550.474605:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4628abb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa71 expref: 47 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309550.474619:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628ac2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa71 expref: 46 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309550.474631:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c8c3d81900) 00010000:00010000:0.0:1788309550.474633:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788309550.474635:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8c153a200, rc 0) 00000100:00100000:0.0:1788309550.474670:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f5241180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+46:10390:x1875178192669312:12345-192.168.202.55@tcp:101:bash.0 Request processed in 4502us (4930us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309550.474675:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 59 00000100:00100000:3.0:1788309550.478742:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309550.478847:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192669696 00000100:00100000:0.0:1788309550.478856:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192669696 00000100:00100000:0.0:1788309550.478904:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 15 00000100:00100000:0.0:1788309550.478911:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e663bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+46:10390:x1875178192669696:12345-192.168.202.55@tcp:35:bash.0 00000100:00100000:0.0:1788309550.479143:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e663bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+47:10390:x1875178192669696:12345-192.168.202.55@tcp:35:bash.0 Request processed in 231us (409us total) trans 4294967344 rc 0/0 00000100:00100000:0.0:1788309550.479151:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 15 00000100:00100000:2.0:1788309550.589145:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309550.589235:0:8305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192669952 00000100:00100000:3.0:1788309550.589245:0:8305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192669952 00000100:00100000:3.0:1788309550.589331:0:8305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 60 00000100:00100000:3.0:1788309550.589341:0:8305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecfd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+47:10400:x1875178192669952:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:3.0:1788309550.589367:0:8305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309550.589388:0:8305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628ac9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146aa78 expref: -99 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788309550.589518:0:8305:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1788309550.589654:0:8305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628ac9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa78 expref: 49 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309550.589669:0:8305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c8c3d81800) 00010000:00010000:3.0:1788309550.589672:0:8305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788309550.589678:0:8305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628ac9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa78 expref: 49 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309550.589693:0:8305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8c153ac00, rc 0) 00000100:00100000:3.0:1788309550.590001:0:8305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecfd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+48:10400:x1875178192669952:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 660us (867us total) trans 4294967345 rc 301/301 00000100:00100000:3.0:1788309550.590021:0:8305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 60 00000100:00100000:1.0:1788309550.594239:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309550.594394:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192670080 00000100:00100000:2.0:1788309550.594404:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192670080 00000100:00100000:2.0:1788309550.594486:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 61 00000100:00100000:2.0:1788309550.594497:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f5241f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+48:10400:x1875178192670080:12345-192.168.202.55@tcp:34:lfs.0 00010000:00010000:2.0:1788309550.594585:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4628ad7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.594602:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4628ad7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.594614:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4628ad7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.594630:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8a00/0x63a04852f4628ade lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.594652:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8a00/0x63a04852f4628ade lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.594659:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8a00/0x63a04852f4628ade lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.594758:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628ae5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.594768:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628ae5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.594788:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628ae5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788309550.594829:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628ae5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.594843:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4628ad7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.594849:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4628ad7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.594857:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4628ad7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.594864:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d8c00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309550.594869:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4628ad7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.594876:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4628ad7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.594895:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97c8d832f400) 00010000:00010000:2.0:1788309550.594898:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788309550.594903:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4628ad7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.594910:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4628ad7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.594925:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8a00/0x63a04852f4628ade lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.595126:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8a00/0x63a04852f4628ade lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.595137:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8a00/0x63a04852f4628ade lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.595142:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d8a00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309550.595145:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8a00/0x63a04852f4628ade lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.595152:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8a00/0x63a04852f4628ade lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.595161:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97c8d83f4e00) 00010000:00010000:2.0:1788309550.595164:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788309550.595167:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8a00/0x63a04852f4628ade lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.595173:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8a00/0x63a04852f4628ade lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.595201:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628ae5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.595207:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628ae5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.595213:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628ae5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.595217:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d8000 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309550.595221:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628ae5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.595227:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628ae5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.595234:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c8c3d81900) 00010000:00010000:2.0:1788309550.595236:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788309550.595240:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628ae5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.595246:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628ae5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309550.595618:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f5241f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+48:10400:x1875178192670080:12345-192.168.202.55@tcp:34:lfs.0 Request processed in 1119us (1385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309550.595627:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 61 00000100:00100000:0.0:1788309550.600575:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309550.600964:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192670336 00000100:00100000:2.0:1788309550.600975:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192670336 00000100:00100000:2.0:1788309550.601035:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 16 00000100:00100000:2.0:1788309550.601062:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f5246680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+48:10400:x1875178192670336:12345-192.168.202.55@tcp:35:lfs.0 00000100:00100000:2.0:1788309550.601361:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f5246680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+49:10400:x1875178192670336:12345-192.168.202.55@tcp:35:lfs.0 Request processed in 301us (795us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1788309550.601370:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 16 00000100:00100000:3.0:1788309550.647730:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309550.647860:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192670592 00000100:00100000:2.0:1788309550.647871:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192670592 00000100:00100000:2.0:1788309550.647938:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 62 00000100:00100000:2.0:1788309550.647950:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c958ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+49:10403:x1875178192670592:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:2.0:1788309550.647977:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309550.647997:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628aec lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146aa7f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.648075:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8a00/0x63a04852f4628af3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.648088:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8a00/0x63a04852f4628af3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.648099:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8a00/0x63a04852f4628af3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.648112:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4628afa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.648120:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4628afa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.648126:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4628afa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.648327:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628b01 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.648337:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628b01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.648344:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628b01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788309550.648355:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788309550.648471:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8a00/0x63a04852f4628af3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.648479:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8a00/0x63a04852f4628af3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.648486:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8a00/0x63a04852f4628af3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.648492:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d8a00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309550.648496:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8a00/0x63a04852f4628af3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.648504:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8a00/0x63a04852f4628af3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.648518:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97c8d832f400) 00010000:00010000:2.0:1788309550.648521:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788309550.648526:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8a00/0x63a04852f4628af3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.648544:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8a00/0x63a04852f4628af3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.648561:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4628afa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.648567:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4628afa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.648575:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4628afa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.648580:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d8c00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309550.648583:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4628afa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.648589:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4628afa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.648597:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97c8d83f4e00) 00010000:00010000:2.0:1788309550.648600:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788309550.648603:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4628afa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.648608:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4628afa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.648651:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628aec lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa7f expref: 52 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.648663:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628b01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa7f expref: 51 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.648677:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c8c3d81900) 00010000:00010000:2.0:1788309550.648680:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788309550.648682:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8e26d9c00, rc 0) 00000100:00100000:2.0:1788309550.648736:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c958ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+51:10403:x1875178192670592:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 788us (1018us total) trans 4294967347 rc 0/0 00000100:00100000:2.0:1788309550.648743:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 62 00000100:00100000:1.0:1788309550.652998:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309550.653202:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192670720 00000100:00100000:2.0:1788309550.653213:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192670720 00000100:00100000:2.0:1788309550.653267:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 63 00000100:00100000:2.0:1788309550.653306:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f5240e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+51:10403:x1875178192670720:12345-192.168.202.55@tcp:54:lfs.0 00010000:00010000:2.0:1788309550.653381:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628b0f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.653399:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628b0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.653409:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628b0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.653466:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628b0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.653473:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628b0f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.653480:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628b0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.653486:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d8e00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309550.653506:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628b0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.653514:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628b0f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.653527:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c8c3d81900) 00010000:00010000:2.0:1788309550.653530:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788309550.653545:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628b0f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.653553:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628b0f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309550.653639:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f5240e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+51:10403:x1875178192670720:12345-192.168.202.55@tcp:54:lfs.0 Request processed in 362us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309550.653648:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 63 00000100:00100000:0.0:1788309550.656663:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309550.657092:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192670976 00000100:00100000:2.0:1788309550.657104:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192670976 00000100:00100000:2.0:1788309550.657161:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 17 00000100:00100000:2.0:1788309550.657171:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f5244380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+51:10403:x1875178192670976:12345-192.168.202.55@tcp:35:lfs.0 00000100:00100000:2.0:1788309550.657583:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f5244380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+52:10403:x1875178192670976:12345-192.168.202.55@tcp:35:lfs.0 Request processed in 411us (927us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1788309550.657601:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 17 00000100:00100000:1.0:1788309550.663245:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309550.668612:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192671104 00000100:00100000:2.0:1788309550.668630:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192671104 00000100:00100000:2.0:1788309550.668713:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 4 00000100:00100000:2.0:1788309550.668725:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f5243100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+52:2350:x1875178192671104:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788309550.668741:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788309550.668799:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628b01 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa7f expref: 52 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.668821:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c8c3d81900) 00010000:00010000:2.0:1788309550.668827:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788309550.668894:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f5243100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+51:2350:x1875178192671104:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 171us (5660us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309550.668901:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 4 00010000:00010000:1.0:1788309550.816815:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788309550.826893:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309550.827039:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192671360 00000100:00100000:2.0:1788309550.827050:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192671360 00000100:00100000:2.0:1788309550.827115:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 64 00000100:00100000:2.0:1788309550.827126:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f5245f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+51:10421:x1875178192671360:12345-192.168.202.55@tcp:101:cat.0 00010000:00010000:2.0:1788309550.827153:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309550.827175:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628b16 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146aa86 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.827307:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628b1d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.827323:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628b1d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.827336:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628b1d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788309550.827349:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788309550.827496:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628b16 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa86 expref: 54 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.827608:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628b1d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa86 expref: 53 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.827618:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c8c3d81900) 00010000:00010000:2.0:1788309550.827621:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788309550.827625:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8e26d8e00, rc 0) 00000100:00100000:2.0:1788309550.827735:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f5245f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+53:10421:x1875178192671360:12345-192.168.202.55@tcp:101:cat.0 Request processed in 609us (850us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1788309550.827743:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 64 00000100:00100000:1.0:1788309550.857912:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309550.858021:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192671488 00000100:00100000:2.0:1788309550.858031:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192671488 00000100:00100000:2.0:1788309550.858094:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 65 00000100:00100000:2.0:1788309550.858106:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f5242d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+53:10422:x1875178192671488:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:2.0:1788309550.858142:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309550.858164:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628b2b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146aa8d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.858220:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628b32 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.858242:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628b32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.858250:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628b32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788309550.858324:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1788309550.858338:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1788309550.858358:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628b32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.858503:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628b2b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa8d expref: 55 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.858525:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628b32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa8d expref: 54 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.858542:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97c8d832f400) 00010000:00010000:2.0:1788309550.858546:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788309550.858549:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8e26d8000, rc 0) 00000100:00100000:2.0:1788309550.858615:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f5242d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+54:10422:x1875178192671488:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 511us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309550.858623:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 65 00000100:00100000:0.0:1788309550.864888:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309550.864982:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192671872 00000100:00100000:2.0:1788309550.864992:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192671872 00000100:00100000:2.0:1788309550.865098:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 18 00000100:00100000:2.0:1788309550.865306:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f5245880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+54:10422:x1875178192671872:12345-192.168.202.55@tcp:35:lfs.0 00000100:00100000:2.0:1788309550.865718:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f5245880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+55:10422:x1875178192671872:12345-192.168.202.55@tcp:35:lfs.0 Request processed in 607us (838us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1788309550.865727:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 18 00000100:00100000:0.0:1788309550.869022:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309550.869952:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192672000 00000100:00100000:1.0:1788309550.869963:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192672000 00000100:00100000:1.0:1788309550.870077:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 5 00000100:00100000:1.0:1788309550.870089:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f5245180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+55:10422:x1875178192672000:12345-192.168.202.55@tcp:103:lfs.0 00010000:00010000:1.0:1788309550.870105:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788309550.870141:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628ac2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa71 expref: 55 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309550.870162:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628b1d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa86 expref: 54 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309550.870176:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f46289cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa32 expref: 53 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309550.870188:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c8c3d81900) 00010000:00010000:1.0:1788309550.870201:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788309550.870266:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f5245180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+52:10422:x1875178192672000:12345-192.168.202.55@tcp:103:lfs.0 Request processed in 174us (1251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309550.870274:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 5 00000100:00100000:1.0:1788309550.873846:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309550.873967:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192672128 00000100:00100000:2.0:1788309550.873977:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192672128 00000100:00100000:2.0:1788309550.874071:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 66 00000100:00100000:2.0:1788309550.874082:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f5242680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+52:10422:x1875178192672128:12345-192.168.202.55@tcp:58:lfs.0 00010000:00010000:2.0:1788309550.874267:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628b39 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.874522:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628b39 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309550.874544:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628b39 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788309550.874974:0:5838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788309550.875645:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1788309550.875718:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1788309550.876911:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f5242680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+52:10422:x1875178192672128:12345-192.168.202.55@tcp:58:lfs.0 Request processed in 2822us (3066us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309550.876924:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 66 00000100:00100000:0.0:1788309550.900227:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309550.900543:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192672256 00000100:00100000:3.0:1788309550.900554:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192672256 00000100:00100000:3.0:1788309550.900615:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 67 00000100:00100000:3.0:1788309550.900629:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f4ce2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+52:10424:x1875178192672256:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:3.0:1788309550.900650:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309550.900673:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628b40 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146aa94 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309550.900744:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4628b47 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309550.900759:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4628b47 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309550.900780:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4628b47 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309550.900796:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628b4e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309550.900802:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628b4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309550.900809:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628b4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309550.900911:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4628b55 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309550.900933:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4628b55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309550.900940:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4628b55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788309550.900976:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788309550.900980:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788309550.900998:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4628b55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309550.901011:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4628b55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309550.901020:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4628b47 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309550.901027:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4628b47 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309550.901033:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4628b47 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309550.901040:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8c153a000 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:3.0:1788309550.901044:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4628b47 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309550.901051:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4628b47 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309550.901063:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97c8d832f400) 00010000:00010000:3.0:1788309550.901066:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788309550.901078:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4628b47 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309550.901084:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4628b47 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309550.901100:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628b4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309550.901106:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628b4e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309550.901125:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628b4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309550.901131:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8c153a200 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:3.0:1788309550.901133:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628b4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309550.901139:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628b4e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309550.901146:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97c8c3d81b00) 00010000:00010000:3.0:1788309550.901148:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788309550.901151:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628b4e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309550.901157:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628b4e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309550.901193:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628b40 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa94 expref: 54 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309550.901220:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4628b55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa94 expref: 53 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309550.901228:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c8d83f4e00) 00010000:00010000:3.0:1788309550.901242:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788309550.901245:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8c153bc00, rc 0) 00000100:00100000:3.0:1788309550.902318:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f4ce2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+53:10424:x1875178192672256:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 1685us (2095us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309550.902327:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 67 00000001:00080000:0.0:1788309551.199160:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967344 is committed 00000001:00080000:0.0:1788309551.199210:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967350 is committed 00000004:00080000:0.0:1788309551.199241:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:0.0:1788309551.199257:0:5859:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff97c8efc3f000 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1788309551.199262:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97c8e0671f00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff97c8efc3f480 00000020:00080000:0.0:1788309551.199265:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97c8e0671d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff97c8ffacb000 00000100:00100000:0.0:1788309551.199433:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffcab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210524032:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788309551.199505:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309551.199582:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210524032 00000100:00100000:0.0:1788309551.199590:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210524032 00000100:00100000:0.0:1788309551.199644:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788309551.199654:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffcab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3301:x1875178210524032:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788309551.199679:0:6682:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:0.0:1788309551.199715:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a97702c, atime: 0x6a97702c, ctime: 0x6a97702c, blocks: 0x1 00010000:00010000:0.0:1788309551.199724:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d88ce9a/0x63a04852f4628b5c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309551.199741:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=313s v=(0 0) 00010000:00010000:0.0:1788309551.199746:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788309551.199752:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d88ce9a/0x63a04852f4628b5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309551.199767:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d88ce9a/0x63a04852f4628b5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309551.199776:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d88ce9a/0x63a04852f4628b5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309551.199784:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d88ce9a/0x63a04852f4628b5c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309551.199803:0:6682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788309551.200325:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffcab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3301:x1875178210524032:12345-0@lo:6:osp-syn-0-0.0 Request processed in 670us (817us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788309551.200339:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1788309551.200366:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788309551.200379:0:7628:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788309551.200385:0:7628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d88ce9a/0x63a04852f4628b5c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309551.200394:0:7628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8ecf2f000 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:0.0:1788309551.200399:0:7628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d88ce9a/0x63a04852f4628b5c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309551.200408:0:7628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d88ce9a/0x63a04852f4628b5c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309551.200439:0:7628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d88ce9a/0x63a04852f4628b5c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309551.200446:0:7628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d88ce9a/0x63a04852f4628b5c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309551.200467:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309551.200469:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309551.200471:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788309551.200501:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97c8ffcab800/2, rc 0, transno 4294967301 00000100:00100000:0.0:1788309551.200509:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffcab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210524032:0@lo:6:osp-syn-0-0.0 00000020:00080000:1.0:1788309551.201317:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1788309551.201429:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:00080000:1.0:1788309551.714044:0:11678:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788309551.714053:0:11678:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788309551.714119:0:11678:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788309551.714126:0:11678:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788309551.714267:0:11678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8f5243480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11678:1875178210524160:192.168.202.55@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788309551.714407:0:11678:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8ea245180 going to sleep for 11 seconds 00000100:00100000:0.0:1788309551.740592:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309551.741363:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192672384 00000100:00100000:3.0:1788309551.741375:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192672384 00000100:00100000:3.0:1788309551.741445:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 1 00000100:00100000:3.0:1788309551.741458:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8eff0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+12:10435:x1875178192672384:12345-192.168.202.55@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788309551.741560:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8eff0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+12:10435:x1875178192672384:12345-192.168.202.55@tcp:900:lhsmtool_posix.0 Request processed in 105us (980us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309551.741568:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 1 00000100:00100000:3.0:1788309551.750532:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309551.750575:0:8305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192672512 00000100:00100000:3.0:1788309551.750586:0:8305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192672512 00000100:00100000:3.0:1788309551.750642:0:8305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 68 00000100:00100000:3.0:1788309551.750653:0:8305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c958ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+12:10435:x1875178192672512:12345-192.168.202.55@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788309551.750685:0:8305:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788309551.750908:0:8305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c958ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+12:10435:x1875178192672512:12345-192.168.202.55@tcp:53:lhsmtool_posix.0 Request processed in 256us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309551.750925:0:8305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 68 00000100:00100000:2.0:1788309551.751033:0:11678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8f5243480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11678:1875178210524160:192.168.202.55@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788309551.755639:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309551.755728:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192672640 00000100:00100000:0.0:1788309551.755746:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192672640 00000100:00100000:0.0:1788309551.755818:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 69 00000100:00100000:0.0:1788309551.755830:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c958fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+11:10435:x1875178192672640:12345-192.168.202.55@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788309551.755914:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2fe00/0x63a04852f4628b63 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309551.755952:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2fe00/0x63a04852f4628b63 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309551.755967:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2fe00/0x63a04852f4628b63 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309551.755983:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f200/0x63a04852f4628b6a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309551.755991:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f200/0x63a04852f4628b6a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309551.755997:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f200/0x63a04852f4628b6a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309551.756027:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e400/0x63a04852f4628b71 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309551.756036:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e400/0x63a04852f4628b71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309551.756043:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e400/0x63a04852f4628b71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788309551.756085:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788309551.756090:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788309551.756110:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e400/0x63a04852f4628b71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309551.756123:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2fe00/0x63a04852f4628b63 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309551.756130:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2fe00/0x63a04852f4628b63 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309551.756136:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2fe00/0x63a04852f4628b63 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309551.756141:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8ecf2fe00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:0.0:1788309551.756147:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2fe00/0x63a04852f4628b63 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309551.756154:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2fe00/0x63a04852f4628b63 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309551.756166:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97c8c2ab9600) 00010000:00010000:0.0:1788309551.756168:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788309551.756173:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2fe00/0x63a04852f4628b63 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309551.756179:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2fe00/0x63a04852f4628b63 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309551.756193:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f200/0x63a04852f4628b6a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309551.756199:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f200/0x63a04852f4628b6a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309551.756204:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f200/0x63a04852f4628b6a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309551.756214:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8ecf2f200 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:0.0:1788309551.756217:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f200/0x63a04852f4628b6a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309551.756223:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f200/0x63a04852f4628b6a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309551.756231:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff97c8c2ab9100) 00010000:00010000:0.0:1788309551.756233:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788309551.756236:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f200/0x63a04852f4628b6a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309551.756242:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f200/0x63a04852f4628b6a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309551.756255:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e400/0x63a04852f4628b71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309551.756262:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e400/0x63a04852f4628b71 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309551.756267:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e400/0x63a04852f4628b71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309551.756272:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8ecf2e400 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:0.0:1788309551.756296:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e400/0x63a04852f4628b71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309551.756303:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e400/0x63a04852f4628b71 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309551.756319:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c8d83f4e00) 00010000:00010000:0.0:1788309551.756322:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788309551.756324:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e400/0x63a04852f4628b71 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309551.756330:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e400/0x63a04852f4628b71 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309551.756402:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c958fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+11:10435:x1875178192672640:12345-192.168.202.55@tcp:34:lhsmtool_posix.0 Request processed in 573us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309551.756420:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 69 00000100:00100000:1.0:1788309551.769888:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309551.769971:0:8305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192672896 00000100:00100000:2.0:1788309551.769983:0:8305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192672896 00000100:00100000:2.0:1788309551.770055:0:8305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 70 00000100:00100000:2.0:1788309551.770067:0:8305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f5240380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+11:10435:x1875178192672896:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788309551.770089:0:8305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309551.770120:0:8305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4628b78 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146aa9b expref: -99 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309551.770226:0:8305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8a00/0x63a04852f4628b7f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309551.770255:0:8305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8a00/0x63a04852f4628b7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309551.770294:0:8305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8a00/0x63a04852f4628b7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788309551.770314:0:8305:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788309551.770522:0:8305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8a00/0x63a04852f4628b7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309551.770531:0:8305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8a00/0x63a04852f4628b7f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309551.770538:0:8305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8a00/0x63a04852f4628b7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309551.770722:0:8305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d8a00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309551.770728:0:8305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8a00/0x63a04852f4628b7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309551.770737:0:8305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8a00/0x63a04852f4628b7f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309551.770751:0:8305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c8d83f4e00) 00010000:00010000:2.0:1788309551.770754:0:8305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788309551.770758:0:8305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8a00/0x63a04852f4628b7f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309551.770765:0:8305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8a00/0x63a04852f4628b7f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309551.770809:0:8305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4628b78 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa9b expref: 13 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309551.770820:0:8305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97c8c2ab9600) 00010000:00010000:2.0:1788309551.770822:0:8305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788309551.770832:0:8305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4628b78 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa9b expref: 13 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309551.770843:0:8305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8e26d8c00, rc 0) 00000100:00100000:2.0:1788309551.770918:0:8305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f5240380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+12:10435:x1875178192672896:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 852us (1040us total) trans 4294967351 rc 301/301 00000100:00100000:2.0:1788309551.770925:0:8305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 70 00000100:00100000:2.0:1788309551.776847:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309551.777457:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192673024 00000100:00100000:0.0:1788309551.777468:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192673024 00000100:00100000:0.0:1788309551.777634:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 71 00000100:00100000:0.0:1788309551.777647:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecfd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+12:10435:x1875178192673024:12345-192.168.202.55@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788309551.777694:0:5837:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788309551.777898:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecfd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+12:10435:x1875178192673024:12345-192.168.202.55@tcp:53:lhsmtool_posix.0 Request processed in 252us (1062us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309551.777907:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 71 00000100:00100000:0.0:1788309551.781804:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000040:00080000:0.0:1788309551.784587:0:11990:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788309551.784598:0:11990:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788309551.784635:0:11990:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788309551.784641:0:11990:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788309551.785852:0:8305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192673280 00000100:00100000:3.0:1788309551.785863:0:8305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192673280 00000100:00100000:3.0:1788309551.785935:0:8305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 72 00000100:00100000:3.0:1788309551.785948:0:8305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8eff0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+12:10435:x1875178192673280:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788309551.785971:0:8305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309551.785974:0:8305:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788309551.786002:0:8305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628b32 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa8d expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309551.786019:0:8305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97c8d832f400) 00010000:00010000:3.0:1788309551.786023:0:8305:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788309551.786036:0:8305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628b8d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146aaa2 expref: -99 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788309551.786970:0:8305:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:3.0:1788309551.787238:0:8305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628b94 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309551.787253:0:8305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628b94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309551.787264:0:8305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628b94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309551.787348:0:8305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628b8d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aaa2 expref: 14 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309551.787381:0:8305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628b94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aaa2 expref: 13 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309551.787390:0:8305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97c8c3d81200) 00010000:00010000:3.0:1788309551.787393:0:8305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788309551.787396:0:8305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8c153a200, rc 0) 00000100:00100000:3.0:1788309551.787499:0:8305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8eff0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+13:10435:x1875178192673280:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 1554us (5704us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1788309551.787507:0:8305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 72 00000100:00100000:0.0:1788309551.791372:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309551.791421:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192673536 00000100:00100000:0.0:1788309551.791432:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192673536 00000100:00100000:0.0:1788309551.792843:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 73 00000100:00100000:0.0:1788309551.792862:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8eff0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+13:10435:x1875178192673536:12345-192.168.202.55@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788309551.792933:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788309551.792963:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628b94 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aaa2 expref: 13 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309551.792980:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97c8c3d81200) 00010000:00010000:0.0:1788309551.792993:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788309551.793016:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f200/0x63a04852f4628ba2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309551.793029:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f200/0x63a04852f4628ba2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309551.793038:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f200/0x63a04852f4628ba2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309551.793089:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2fe00/0x63a04852f4628ba9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x3771c622 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309551.793096:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2fe00/0x63a04852f4628ba9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x3771c622 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309551.793102:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2fe00/0x63a04852f4628ba9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x3771c622 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309551.793382:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f200/0x63a04852f4628ba2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309551.793391:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f200/0x63a04852f4628ba2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309551.793406:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f200/0x63a04852f4628ba2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309551.793424:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8ecf2f200 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:0.0:1788309551.793428:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f200/0x63a04852f4628ba2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309551.793434:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f200/0x63a04852f4628ba2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309551.793444:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97c8d832f400) 00010000:00010000:0.0:1788309551.793447:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788309551.793451:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f200/0x63a04852f4628ba2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309551.793458:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f200/0x63a04852f4628ba2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309551.793470:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2fe00/0x63a04852f4628ba9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x3771c622 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309551.793487:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2fe00/0x63a04852f4628ba9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x3771c622 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309551.793493:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2fe00/0x63a04852f4628ba9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x3771c622 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309551.793499:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8ecf2fe00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:0.0:1788309551.793502:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2fe00/0x63a04852f4628ba9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x3771c622 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309551.793518:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2fe00/0x63a04852f4628ba9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x3771c622 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309551.793536:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x3771c622 (ffff97c8c2ab9100) 00010000:00010000:0.0:1788309551.793538:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788309551.793541:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2fe00/0x63a04852f4628ba9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x3771c622 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309551.793546:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2fe00/0x63a04852f4628ba9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x3771c622 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309551.793640:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8eff0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+12:10435:x1875178192673536:12345-192.168.202.55@tcp:36:lhsmtool_posix.0 Request processed in 784us (2278us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788309551.797476:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309551.797599:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192673664 00000100:00100000:3.0:1788309551.797612:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192673664 00000100:00100000:3.0:1788309551.797679:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 74 00000100:00100000:3.0:1788309551.797690:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f5242a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+13:10435:x1875178192673664:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788309551.797715:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309551.797744:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4628bb0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146aaa9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309551.797786:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f4628bb7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309551.797800:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f4628bb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309551.797811:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f4628bb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309551.797921:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4628bb0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aaa9 expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309551.797946:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f4628bb7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aaa9 expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309551.797955:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97c8c3d81b00) 00010000:00010000:3.0:1788309551.797959:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788309551.797963:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8d73ee400, rc 0) 00000100:00100000:3.0:1788309551.798041:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f5242a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+14:10435:x1875178192673664:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 352us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309551.798050:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 74 00000100:00100000:0.0:1788309551.798232:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 73 00000100:00100000:2.0:1788309551.804571:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309551.805125:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192673920 00000100:00100000:3.0:1788309551.805136:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192673920 00000100:00100000:3.0:1788309551.812373:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 75 00000100:00100000:3.0:1788309551.812393:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecfd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+13:10435:x1875178192673920:12345-192.168.202.55@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788309551.812540:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f4628bbe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309551.812559:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f4628bbe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309551.812572:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f4628bbe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788309551.812877:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:3.0:1788309551.812887:0:5839:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 314563609312ns, next at 315563607063ns, rc = 0 00000004:00010000:3.0:1788309551.812981:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c7775218 reply state 0000000098d2df2b transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f4628bbe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309551.813004:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788309551.813141:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecfd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+15:10435:x1875178192673920:12345-192.168.202.55@tcp:36:lhsmtool_posix.0 Request processed in 754us (8593us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1788309551.813148:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 75 00010000:00010000:2.0:1788309551.825404:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f4628bbe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309551.825433:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f4628bbe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309551.825441:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f4628bbe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309551.825447:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8d73ef200 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309551.825453:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f4628bbe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309551.825460:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f4628bbe lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309551.825481:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97c8c3d81b00) 00010000:00010000:2.0:1788309551.825484:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788309551.825489:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f4628bbe lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309551.825495:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f4628bbe lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309551.836917:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309551.837060:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192674048 00000100:00100000:3.0:1788309551.837070:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192674048 00000100:00100000:3.0:1788309551.837168:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 76 00000100:00100000:3.0:1788309551.837180:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f5243800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+14:10435:x1875178192674048:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788309551.837207:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309551.837231:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4628bc5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146aab0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309551.837317:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4628bc5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aab0 expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309551.837332:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4628bc5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aab0 expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309551.837355:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97c8c3d81b00) 00010000:00010000:3.0:1788309551.837358:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788309551.837362:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8d73eee00, rc 0) 00000100:00100000:3.0:1788309551.837430:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f5243800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+15:10435:x1875178192674048:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 252us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309551.837437:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 76 00010000:00010000:1.0:1788309551.842230:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788309551.844956:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309551.845037:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192674176 00000100:00100000:3.0:1788309551.845048:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192674176 00000100:00100000:3.0:1788309551.845105:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 25 00000100:00100000:3.0:1788309551.845115:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f5241500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2349:x1875178192674176:12345-192.168.202.55@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1788309551.845152:0:6681:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 86451057-f8bb-4d7c-a7c2-5c834b43e3d3@192.168.202.55@tcp t0 exp 0000000000000000 cur 314 last 0 00000020:00000080:3.0:1788309551.845185:0:6681:0:(genops.c:1385:class_connect()) connect: client 86451057-f8bb-4d7c-a7c2-5c834b43e3d3, cookie 0x63a04852f4628bcc 00002000:00100000:3.0:1788309551.845198:0:6681:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 86451057-f8bb-4d7c-a7c2-5c834b43e3d3/ffff97c8d0dae800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392d ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788309551.845224:0:6681:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788309551.845692:0:6681:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788309551.845729:0:6681:0:(import.c:65:import_set_state_nolock()) ffff97c8d0daf800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788309551.845800:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f5241500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:2349:x1875178192674176:12345-192.168.202.55@tcp:8:lhsmtool_posix.0 Request processed in 683us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309551.845810:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 25 00000100:00100000:1.0:1788309551.847965:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309551.848074:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192674304 00000100:00100000:0.0:1788309551.848086:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192674304 00000100:00100000:0.0:1788309551.848164:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 26 00000100:00100000:0.0:1788309551.848177:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f5240700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:0:x1875178192674304:12345-192.168.202.55@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1788309551.848954:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788309551.922021:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f5240700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+7:0:x1875178192674304:12345-192.168.202.55@tcp:2:lhsmtool_posix.0 Request processed in 73837us (74054us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788309551.922034:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 26 00000001:00080000:0.0:1788309551.922068:0:7639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00100000:0.0:1788309551.922077:0:7639:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 86451057-f8bb-4d7c-a7c2-5c834b43e3d3 00000100:00100000:1.0:1788309551.930256:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309551.934462:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192674560 00000100:00100000:3.0:1788309551.934480:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192674560 00000100:00100000:3.0:1788309551.934553:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 19 00000100:00100000:3.0:1788309551.934566:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f5243b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+15:10435:x1875178192674560:12345-192.168.202.55@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788309551.934870:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f5243b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+16:10435:x1875178192674560:12345-192.168.202.55@tcp:35:lhsmtool_posix.0 Request processed in 306us (4625us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1788309551.934879:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 19 00000100:00100000:1.0:1788309551.941375:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309551.941483:0:8305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192674816 00000100:00100000:3.0:1788309551.941502:0:8305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192674816 00000100:00100000:3.0:1788309551.941593:0:8305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 77 00000100:00100000:3.0:1788309551.941608:0:8305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f5240000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+16:10435:x1875178192674816:12345-192.168.202.55@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788309551.941785:0:8305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f5240000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+16:10435:x1875178192674816:12345-192.168.202.55@tcp:57:lhsmtool_posix.0 Request processed in 181us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309551.941794:0:8305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 77 00000100:00100000:1.0:1788309551.949624:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309551.949788:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192674944 00000100:00100000:3.0:1788309551.949799:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192674944 00000100:00100000:3.0:1788309551.949860:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 78 00000100:00100000:3.0:1788309551.949871:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f5242300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+16:10435:x1875178192674944:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788309551.949890:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309551.949911:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f4628bd3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146aab7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309551.949982:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4628bda lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309551.949995:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4628bda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309551.950007:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4628bda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788309551.950047:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788309551.950067:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4628bda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309551.950095:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f4628bd3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aab7 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309551.950111:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4628bda lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aab7 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309551.950120:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97c8c3d81b00) 00010000:00010000:3.0:1788309551.950122:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788309551.950126:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8c153a000, rc 0) 00000100:00100000:3.0:1788309551.950195:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f5242300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+17:10435:x1875178192674944:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 326us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309551.950203:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 78 00000100:00100000:1.0:1788309551.964123:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309551.964215:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192675072 00000100:00100000:3.0:1788309551.964227:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192675072 00000100:00100000:3.0:1788309551.964319:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 27 00000100:00100000:3.0:1788309551.964333:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f5241c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+5:2350:x1875178192675072:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788309551.964353:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309551.964377:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c0a92bcf/0x63a04852f4628be1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146aabe expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788309551.964419:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a97702f, blocks: 0x1 00010000:00010000:3.0:1788309551.964445:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=314s v=(0 0) 00010000:00010000:3.0:1788309551.964449:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788309551.964460:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0a92bcf/0x63a04852f4628be1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aabe expref: 6 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309551.964484:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c0a92bcf/0x63a04852f4628be1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aabe expref: 6 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309551.964500:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8c153a200, rc 0) 00000100:00100000:3.0:1788309551.964575:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f5241c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:2350:x1875178192675072:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 245us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309551.964582:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 27 00000100:00100000:3.0:1788309551.983225:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309551.983329:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192675328 00000100:00100000:0.0:1788309551.983340:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192675328 00000100:00100000:0.0:1788309551.983405:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 79 00000100:00100000:0.0:1788309551.983437:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecf16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+17:10435:x1875178192675328:12345-192.168.202.55@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788309551.983563:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecf16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+17:10435:x1875178192675328:12345-192.168.202.55@tcp:57:lhsmtool_posix.0 Request processed in 129us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309551.983571:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 79 00000100:00100000:3.0:1788309551.987305:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309551.987371:0:10673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192675456 00000100:00100000:0.0:1788309551.987382:0:10673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192675456 00000100:00100000:0.0:1788309551.987456:0:10673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 28 00000100:00100000:0.0:1788309551.987468:0:10673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc91dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:10435:x1875178192675456:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788309551.987497:0:10673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788309551.987517:0:10673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a1560c2b/0x63a04852f4628be8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146aac5 expref: -99 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309551.987560:0:10673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c0a92bcf/0x63a04852f4628be1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aabe expref: 7 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309551.987569:0:10673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788309551.987573:0:10673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788309551.987579:0:10673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1560c2b/0x63a04852f4628be8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aac5 expref: 7 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309551.987616:0:10673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c0a92bcf/0x63a04852f4628be1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aabe expref: 7 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309551.987630:0:10673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c0a92bcf/0x63a04852f4628be1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aabe expref: 7 pid: 6681 timeout: 414 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309551.987659:0:10673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10673:1875178210524288:192.168.202.55@tcp:104: 00000100:00100000:0.0:1788309551.987763:0:10673:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c826d900 going to sleep for 11 seconds 00000100:00100000:3.0:1788309551.991110:0:10673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10673:1875178210524288:192.168.202.55@tcp:104: 00010000:00010000:3.0:1788309551.991146:0:10673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a1560c2b/0x63a04852f4628be8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aac5 expref: 7 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309551.991171:0:10673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8ecf2f200, rc 0) 00000100:00100000:3.0:1788309551.991235:0:10673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc91dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+7:10435:x1875178192675456:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 3768us (3968us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309551.991244:0:10673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 28 00000100:00100000:1.0:1788309552.009731:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309552.010892:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192675584 00000100:00100000:0.0:1788309552.010907:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192675584 00010000:00010000:0.0:1788309552.010956:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c0a92bcf/0x63a04852f4628be1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aabe expref: 7 pid: 6681 timeout: 414 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309552.010994:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 42 00000100:00100000:0.0:1788309552.011003:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6b28050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+7:2351:x1875178192675584:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788309552.011018:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788309552.011043:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c0a92bcf/0x63a04852f4628be1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aabe expref: 7 pid: 6681 timeout: 414 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309552.011057:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c0a92bcf/0x63a04852f4628be1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aabe expref: 7 pid: 6681 timeout: 414 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309552.011080:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0a92bcf/0x63a04852f4628be1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aabe expref: 7 pid: 6681 timeout: 414 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309552.011094:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788309552.011098:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788309552.011106:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a1560c2b/0x63a04852f4628be8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aac5 expref: 6 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309552.011140:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1560c2b/0x63a04852f4628be8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aac5 expref: 6 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309552.011183:0:5822:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a1560c2b/0x63a04852f4628be8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aac5 expref: 6 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309552.011198:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5822:1875178210524416:192.168.202.55@tcp:105: 00000100:00100000:0.0:1788309552.011300:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c826d000 going to sleep for 11 seconds 00000100:00100000:2.0:1788309552.020356:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5822:1875178210524416:192.168.202.55@tcp:105: 00010000:00010000:2.0:1788309552.020389:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788309552.020480:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6b28050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:2351:x1875178192675584:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 9476us (10760us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309552.020491:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 42 00000100:00100000:2.0:1788309552.022871:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309552.023124:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192675712 00000100:00100000:3.0:1788309552.023135:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192675712 00002000:00100000:3.0:1788309552.023188:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff97c8ecfd0000 x1875178192675712/t0(0) o4->86451057-f8bb-4d7c-a7c2-5c834b43e3d3@192.168.202.55@tcp:708/0 lens 504/0 e 0 to 0 dl 1788309563 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788309552.023201:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97c8ecfd0000 with x1875178192675712 ext(0->8) 00002000:00010000:3.0:1788309552.023207:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97c8ecfd0000 00000100:00100000:3.0:1788309552.023241:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 0 00000100:00100000:3.0:1788309552.023252:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecfd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:2351:x1875178192675712:12345-192.168.202.55@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788309552.024634:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecfd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+8:2351:x1875178192675712:12345-192.168.202.55@tcp:4:lhsmtool_posix.0 Request processed in 1379us (1765us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788309552.024646:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 0 00002000:00100000:3.0:1788309552.024656:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff97c8ecfd0000 x1875178192675712/t4294967302(0) o4->86451057-f8bb-4d7c-a7c2-5c834b43e3d3@192.168.202.55@tcp:708/0 lens 504/448 e 0 to 0 dl 1788309563 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788309552.024666:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97c8ecfd0000 with x1875178192675712 ext(0->8) 00002000:00010000:3.0:1788309552.024672:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97c8ecfd0000 00000100:00100000:0.0:1788309552.037910:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309552.039443:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192675840 00000100:00100000:1.0:1788309552.039456:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192675840 00000100:00100000:1.0:1788309552.039542:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 80 00000100:00100000:1.0:1788309552.039554:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8eff0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+17:10435:x1875178192675840:12345-192.168.202.55@tcp:44:lhsmtool_posix.0 00000100:00080000:0.0:1788309552.042843:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788309552.101448:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8eff0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+17:10435:x1875178192675840:12345-192.168.202.55@tcp:44:lhsmtool_posix.0 Request processed in 61885us (63537us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309552.101461:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 80 00000020:00080000:1.0:1788309552.101715:0:5859:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000001:00080000:1.0:1788309552.101734:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967351 is committed 00000001:00080000:1.0:1788309552.101744:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:1.0:1788309552.101752:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:1.0:1788309552.101771:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:1.0:1788309552.101780:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1788309552.101880:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788309552.101895:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8f5241880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210524544:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788309552.101957:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309552.102013:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210524544 00000100:00100000:1.0:1788309552.102021:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210524544 00000100:00100000:1.0:1788309552.102067:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1788309552.102075:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788309552.102076:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f5240a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210524544:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788309552.102955:0:6681:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788309552.102963:0:6681:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788309551 00002000:00010000:1.0:1788309552.102966:0:6681:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788309552.102968:0:6681:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788309551 -> 1788309551 00002000:00010000:1.0:1788309552.102970:0:6681:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788309552.103085:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f5240a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1875178210524544:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1008us (1125us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788309552.103095:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:3.0:1788309552.109035:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97c8f5241880/2, rc 0, transno 4294967303 00000100:00100000:3.0:1788309552.109056:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8f5241880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210524544:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788309552.109174:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309552.109333:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192675968 00000100:00100000:1.0:1788309552.109341:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192675968 00000100:00100000:1.0:1788309552.109391:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 30 00000100:00100000:1.0:1788309552.109401:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffcd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+8:2351:x1875178192675968:12345-192.168.202.55@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1788309552.153103:0:7639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:0.0:1788309552.153121:0:7639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:2.0:1788309552.153481:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffcd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:2351:x1875178192675968:12345-192.168.202.55@tcp:16:lhsmtool_posix.0 Request processed in 44074us (44302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309552.153491:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 30 00000100:00100000:2.0:1788309552.157685:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309552.157739:0:8305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192676224 00000100:00100000:3.0:1788309552.157751:0:8305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192676224 00000100:00100000:3.0:1788309552.157857:0:8305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 81 00000100:00100000:3.0:1788309552.157868:0:8305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecfd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+13:10435:x1875178192676224:12345-192.168.202.55@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788309552.157922:0:8305:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788309552.157950:0:8305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4628bda lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aab7 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309552.157971:0:8305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97c8c3d81b00) 00010000:00010000:3.0:1788309552.157976:0:8305:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788309552.158008:0:8305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628bef lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309552.158022:0:8305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628bef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309552.158032:0:8305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628bef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788309552.158872:0:8305:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dacbe6bd reply state 00000000979bbfa0 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628bef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309552.158883:0:8305:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788309552.159009:0:8305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecfd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+14:10435:x1875178192676224:12345-192.168.202.55@tcp:36:lhsmtool_posix.0 Request processed in 1141us (1331us total) trans 4294967355 rc 0/0 00000100:00100000:2.0:1788309552.159015:0:8305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 81 00000100:00100000:0.0:1788309552.163723:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309552.163806:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192676352 00000100:00100000:1.0:1788309552.163816:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192676352 00000100:00100000:1.0:1788309552.163876:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 31 00000100:00100000:1.0:1788309552.163889:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffcd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:2350:x1875178192676352:12345-192.168.202.55@tcp:2:lhsmtool_posix.0 00010000:00010000:2.0:1788309552.164022:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628bef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309552.164034:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628bef lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309552.164041:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628bef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309552.164048:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8c153ac00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309552.164068:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628bef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309552.164077:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628bef lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309552.164098:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97c8c3d81b00) 00010000:00010000:2.0:1788309552.164101:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788309552.164105:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628bef lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309552.164124:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628bef lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788309552.164190:0:6680:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1788309552.164194:0:6680:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1788309551 -> 1788309550 00002000:00010000:1.0:1788309552.164197:0:6680:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788309548 00002000:00010000:1.0:1788309552.164200:0:6680:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788309551 -> 1788309550 00002000:00010000:1.0:1788309552.164202:0:6680:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788309552.164322:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffcd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+7:2350:x1875178192676352:12345-192.168.202.55@tcp:2:lhsmtool_posix.0 Request processed in 435us (609us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788309552.164331:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 31 00000100:00100000:1.0:1788309552.168136:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309552.170555:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192676608 00000100:00100000:2.0:1788309552.170570:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192676608 00000100:00100000:2.0:1788309552.170695:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 82 00000100:00100000:2.0:1788309552.170707:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f5243100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+13:10435:x1875178192676608:12345-192.168.202.55@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788309552.170781:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4628bf6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309552.170797:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f4628bb7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aaa9 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309552.170808:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4628bf6 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309552.170845:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f4628bb7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aaa9 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309552.170860:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f4628bb7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aaa9 expref: 13 pid: 5838 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309552.170890:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecfd3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1875178210524672:192.168.202.55@tcp:104: 00000100:00100000:2.0:1788309552.171001:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c3522c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788309552.176167:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecfd3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1875178210524672:192.168.202.55@tcp:104: 00010000:00010000:3.0:1788309552.176203:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4628bf6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309552.177313:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309552.177393:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192676736 00000100:00100000:2.0:1788309552.177402:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192676736 00010000:00010000:2.0:1788309552.177453:0:8447:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f4628bb7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aaa9 expref: 14 pid: 5838 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309552.177494:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 43 00000100:00100000:2.0:1788309552.177504:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffcd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+14:2351:x1875178192676736:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788309552.177519:0:8447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788309552.177526:0:8447:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f4628bb7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aaa9 expref: 14 pid: 5838 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309552.177539:0:8447:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f4628bb7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aaa9 expref: 14 pid: 5838 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309552.177562:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f4628bb7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aaa9 expref: 14 pid: 5838 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309552.177580:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97c8c3d81b00) 00010000:00010000:2.0:1788309552.177586:0:8447:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4628bf6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309552.177596:0:8447:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4628bf6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309552.177622:0:8447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4628bf6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309552.177655:0:8447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788309552.177704:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffcd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+13:2351:x1875178192676736:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 200us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309552.177711:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 43 00010000:00010000:0.0:1788309552.177831:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4628bf6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309552.177839:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4628bf6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309552.177874:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4628bf6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309552.177880:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4628bf6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309552.177897:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4628bf6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309552.177903:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d9a00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:0.0:1788309552.177908:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4628bf6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309552.177916:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4628bf6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309552.177936:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97c8c3d81b00) 00010000:00010000:0.0:1788309552.177939:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788309552.177942:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4628bf6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309552.177949:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4628bf6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309552.178005:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f5243100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+12:10435:x1875178192676608:12345-192.168.202.55@tcp:55:lhsmtool_posix.0 Request processed in 7301us (9880us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788309552.178014:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 82 00000100:00100000:0.0:1788309552.183952:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309552.184037:0:10673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192676864 00000100:00100000:3.0:1788309552.184047:0:10673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192676864 00000100:00100000:3.0:1788309552.184145:0:10673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 32 00000100:00100000:3.0:1788309552.184156:0:10673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffcd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+7:2351:x1875178192676864:12345-192.168.202.55@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788309552.184212:0:10673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000076b14d99/0x63a04852f4628bfd lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309552.184232:0:10673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a1560c2b/0x63a04852f4628be8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aac5 expref: 7 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309552.184240:0:10673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788309552.184245:0:10673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788309552.184249:0:10673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076b14d99/0x63a04852f4628bfd lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309552.184326:0:10673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a1560c2b/0x63a04852f4628be8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aac5 expref: 7 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309552.184340:0:10673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a1560c2b/0x63a04852f4628be8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aac5 expref: 7 pid: 10673 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309552.184354:0:10673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc91d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10673:1875178210524800:192.168.202.55@tcp:104: 00000100:00100000:3.0:1788309552.184440:0:10673:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d6a5b000 going to sleep for 11 seconds 00000100:00100000:2.0:1788309552.189679:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309552.189779:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192676992 00000100:00100000:0.0:1788309552.189790:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192676992 00010000:00010000:0.0:1788309552.189834:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a1560c2b/0x63a04852f4628be8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aac5 expref: 8 pid: 10673 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309552.189884:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 44 00000100:00100000:0.0:1788309552.189896:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecfd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+8:2351:x1875178192676992:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788309552.189943:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788309552.189974:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a1560c2b/0x63a04852f4628be8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aac5 expref: 8 pid: 10673 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309552.189988:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a1560c2b/0x63a04852f4628be8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aac5 expref: 8 pid: 10673 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309552.190015:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788309552.190020:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788309552.190026:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000076b14d99/0x63a04852f4628bfd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309552.190036:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076b14d99/0x63a04852f4628bfd lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309552.190059:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788309552.190120:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecfd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+8:2351:x1875178192676992:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 226us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309552.190128:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 44 00010000:00010000:3.0:1788309552.191006:0:10673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a1560c2b/0x63a04852f4628be8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aac5 expref: 7 pid: 10673 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309552.191027:0:10673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc91d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10673:1875178210524800:192.168.202.55@tcp:104: 00010000:00010000:3.0:1788309552.191050:0:10673:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000076b14d99/0x63a04852f4628bfd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309552.191075:0:10673:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000076b14d99/0x63a04852f4628bfd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309552.191081:0:10673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000076b14d99/0x63a04852f4628bfd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309552.191110:0:10673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000076b14d99/0x63a04852f4628bfd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309552.191118:0:10673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000076b14d99/0x63a04852f4628bfd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309552.191126:0:10673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000076b14d99/0x63a04852f4628bfd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309552.191133:0:10673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8c153a000 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:3.0:1788309552.191137:0:10673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000076b14d99/0x63a04852f4628bfd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309552.191146:0:10673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000076b14d99/0x63a04852f4628bfd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309552.191160:0:10673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000076b14d99/0x63a04852f4628bfd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309552.191179:0:10673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000076b14d99/0x63a04852f4628bfd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309552.191242:0:10673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffcd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:2351:x1875178192676864:12345-192.168.202.55@tcp:1:lhsmtool_posix.0 Request processed in 7088us (7299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309552.191250:0:10673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 32 00000100:00100000:0.0:1788309552.194416:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309552.194593:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192677248 00000100:00100000:1.0:1788309552.194604:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192677248 00000100:00100000:1.0:1788309552.194717:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 83 00000100:00100000:1.0:1788309552.194727:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffcd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+12:10435:x1875178192677248:12345-192.168.202.55@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788309552.194819:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549000/0x63a04852f4628c04 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309552.194836:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549000/0x63a04852f4628c04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309552.194847:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549000/0x63a04852f4628c04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309552.195078:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628c0b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309552.195089:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4628bc5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aab0 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309552.195097:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628c0b lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309552.195138:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4628bc5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aab0 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309552.195153:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4628bc5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aab0 expref: 13 pid: 5838 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309552.195188:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8f5243480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875178210524928:192.168.202.55@tcp:104: 00000100:00100000:1.0:1788309552.195533:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8ea245180 going to sleep for 11 seconds 00000100:00100000:0.0:1788309552.198323:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8f5243480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875178210524928:192.168.202.55@tcp:104: 00010000:00010000:0.0:1788309552.198365:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628c0b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309552.202462:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309552.202623:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192677376 00000100:00100000:2.0:1788309552.202634:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192677376 00010000:00010000:2.0:1788309552.202680:0:8447:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4628bc5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aab0 expref: 14 pid: 5838 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309552.202719:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 45 00000100:00100000:2.0:1788309552.202731:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffcd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+14:2351:x1875178192677376:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788309552.202747:0:8447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788309552.202755:0:8447:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4628bc5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aab0 expref: 14 pid: 5838 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309552.202770:0:8447:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4628bc5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aab0 expref: 14 pid: 5838 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309552.202796:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4628bc5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aab0 expref: 14 pid: 5838 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309552.202817:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97c8c3d81b00) 00010000:00010000:2.0:1788309552.202823:0:8447:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628c0b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309552.202848:0:8447:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628c0b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309552.202855:0:8447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628c0b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309552.202891:0:8447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788309552.203303:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628c0b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309552.203323:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628c0b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788309552.203569:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:0.0:1788309552.203743:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:0.0:1788309552.203794:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:0.0:1788309552.203876:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffcdb100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5839:1875178210525056:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788309552.203930:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309552.203972:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d120b480 going to sleep for 11 seconds 00000100:00100000:3.0:1788309552.204168:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210525056 00000100:00100000:3.0:1788309552.204175:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210525056 00000100:00100000:3.0:1788309552.204230:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788309552.204239:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffcdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5839:x1875178210525056:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788309552.204239:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffcd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+16:2351:x1875178192677376:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 1508us (1789us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309552.204248:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 45 00000100:00100000:3.0:1788309552.204343:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffcdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5839:x1875178210525056:12345-0@lo:1000:mdt00_002.0 Request processed in 104us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309552.204350:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788309552.205254:0:5839:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1788309552.205261:0:5839:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97c8f5241880, transno 4294967303 00000100:00100000:2.0:1788309552.205305:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffcdb100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5839:1875178210525056:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1788309552.206213:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:2.0:1788309552.206325:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e667f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5839:1875178210525184:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788309552.206383:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309552.206431:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c3522cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788309552.206892:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210525184 00000100:00100000:0.0:1788309552.206901:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210525184 00000100:00100000:0.0:1788309552.206958:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788309552.206968:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e667f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5839:x1875178210525184:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788309552.207185:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e667f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5839:x1875178210525184:12345-0@lo:1000:mdt00_002.0 Request processed in 217us (799us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788309552.207192:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788309552.207595:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e667f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5839:1875178210525184:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1788309552.207634:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628c0b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309552.207644:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628c0b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309552.207652:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628c0b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309552.207659:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8f5548e00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309552.207677:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628c0b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309552.207686:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628c0b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309552.207703:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97c8c3d81b00) 00010000:00010000:2.0:1788309552.207706:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788309552.207710:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628c0b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309552.207717:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628c0b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309552.207763:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628b39 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309552.207770:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628b39 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309552.207776:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628b39 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309552.207780:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d9c00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309552.207783:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628b39 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309552.207788:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628b39 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309552.207796:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c8d83f4e00) 00010000:00010000:2.0:1788309552.207799:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788309552.207808:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628b39 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309552.207814:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628b39 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309552.207839:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4628c12 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309552.207855:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4628b55 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa94 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309552.207864:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4628c12 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309552.207894:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4628b55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa94 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309552.207923:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4628b55 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa94 expref: 16 pid: 5839 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309552.207937:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8c958e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875178210525312:192.168.202.55@tcp:104: 00000100:00100000:2.0:1788309552.208004:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c3522cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788309552.212965:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8c958e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875178210525312:192.168.202.55@tcp:104: 00010000:00010000:2.0:1788309552.212997:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4628c12 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309552.213661:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309552.213943:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192677504 00000100:00100000:3.0:1788309552.213952:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192677504 00010000:00010000:3.0:1788309552.213995:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4628b55 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa94 expref: 17 pid: 5839 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309552.214035:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 46 00000100:00100000:3.0:1788309552.214044:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c958e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+17:2350:x1875178192677504:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788309552.214058:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788309552.214065:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4628b55 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa94 expref: 17 pid: 5839 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309552.214077:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4628b55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa94 expref: 17 pid: 5839 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309552.214113:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4628b55 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aa94 expref: 17 pid: 5839 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309552.214131:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c8d83f4e00) 00010000:00010000:3.0:1788309552.214136:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4628c12 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309552.214146:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4628c12 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309552.214154:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4628c12 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309552.214177:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788309552.214229:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c958e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+16:2350:x1875178192677504:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 185us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309552.214236:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 46 00010000:00010000:1.0:1788309552.214403:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4628c12 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309552.214422:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4628c12 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309552.214434:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4628c12 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309552.214440:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4628c12 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309552.214447:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4628c12 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309552.214453:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d9a00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:1.0:1788309552.214458:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4628c12 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309552.214465:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4628c12 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309552.214474:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c8d83f4e00) 00010000:00010000:1.0:1788309552.214477:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788309552.214481:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4628c12 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309552.214487:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4628c12 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309552.214506:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549000/0x63a04852f4628c04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309552.214512:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549000/0x63a04852f4628c04 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309552.214518:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549000/0x63a04852f4628c04 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309552.214523:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8f5549000 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:1.0:1788309552.214526:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549000/0x63a04852f4628c04 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309552.214532:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549000/0x63a04852f4628c04 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309552.214540:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c8d83f4e00) 00010000:00010000:1.0:1788309552.214542:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788309552.214545:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549000/0x63a04852f4628c04 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309552.214551:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549000/0x63a04852f4628c04 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309552.214924:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffcd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+15:10435:x1875178192677248:12345-192.168.202.55@tcp:57:lhsmtool_posix.0 Request processed in 20197us (20522us total) trans 4294967360 rc 0/0 00000100:00100000:1.0:1788309552.214933:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 83 00000020:00080000:1.0:1788309552.214937:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788309552.215415:0:11678:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788309552.215420:0:11678:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788309552.215453:0:11678:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788309552.215460:0:11678:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788309552.219018:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309552.219098:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192677760 00000100:00100000:3.0:1788309552.219107:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192677760 00000100:00100000:3.0:1788309552.219162:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 20 00000100:00100000:3.0:1788309552.219172:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f5247800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+15:10435:x1875178192677760:12345-192.168.202.55@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788309552.220151:0:5840:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788309552.220264:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:3.0:1788309552.220717:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4628c19 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309552.220736:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4628c19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309552.220748:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4628c19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309552.221041:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4628c19 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309552.221050:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4628c19 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309552.221056:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4628c19 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309552.221072:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788309552.221185:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f5247800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+17:10435:x1875178192677760:12345-192.168.202.55@tcp:35:lhsmtool_posix.0 Request processed in 2010us (2172us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1788309552.221196:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 20 00000020:00080000:3.0:1788309552.221202:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788309552.221305:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788309552.221313:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4628c19 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309552.221320:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8c153bc00 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:0.0:1788309552.221325:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4628c19 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309552.221333:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4628c19 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309552.221346:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97c8e2544e00) 00010000:00010000:0.0:1788309552.221357:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788309552.221361:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4628c19 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309552.221367:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4628c19 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309552.221385:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309552.221387:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309552.221389:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309552.864691:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788309553.248520:0:11678:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788309553.248529:0:11678:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788309553.248562:0:11678:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788309553.248569:0:11678:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788309553.632668:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffcdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875178210525824:0@lo:400:kworker.0 00000100:00100000:0.0:1788309553.632747:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309553.632807:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788309553.632815:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffcda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3302:1875178210525440:0@lo:400:kworker.0 00000100:00100000:0.0:1788309553.632843:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309553.632867:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffcdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875178210525952:0@lo:400:kworker.0 00000100:00100000:0.0:1788309553.632893:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309553.632917:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffcdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875178210525568:0@lo:400:kworker.0 00000100:00100000:0.0:1788309553.632940:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309553.632958:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffcd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210526080:0@lo:400:kworker.0 00000100:00100000:0.0:1788309553.632976:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309553.632992:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788309553.632997:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffcd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875178210525696:0@lo:400:kworker.0 00000100:00100000:0.0:1788309553.633018:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309553.634533:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210525952 00000100:00100000:2.0:1788309553.634562:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210525952 00000100:00100000:2.0:1788309553.634624:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210525568 00000100:00100000:2.0:1788309553.634627:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210525568 00000100:00100000:2.0:1788309553.634644:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210525696 00000100:00100000:2.0:1788309553.634646:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210525696 00000100:00100000:2.0:1788309553.634663:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788309553.634672:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffcdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875178210525952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309553.634756:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffcdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875178210525952:12345-0@lo:400:kworker.0 Request processed in 84us (1861us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309553.634763:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788309553.634781:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788309553.634787:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffcd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875178210525568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309553.634819:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffcd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875178210525568:12345-0@lo:400:kworker.0 Request processed in 28us (1874us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309553.634825:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788309553.634836:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788309553.634842:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffcdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875178210525696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309553.634868:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffcdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875178210525696:12345-0@lo:400:kworker.0 Request processed in 26us (1849us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309553.634874:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788309553.634894:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210525440 00000100:00100000:2.0:1788309553.634897:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210525440 00000100:00100000:2.0:1788309553.634929:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1788309553.634935:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:3302:x1875178210525440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309553.634964:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:3302:x1875178210525440:12345-0@lo:400:kworker.0 Request processed in 29us (2120us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309553.634969:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1788309553.635005:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210525824 00000100:00100000:2.0:1788309553.635009:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210525824 00000100:00100000:2.0:1788309553.635035:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210526080 00000100:00100000:2.0:1788309553.635038:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210526080 00000100:00100000:2.0:1788309553.635055:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788309553.635060:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffcd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3302:x1875178210525824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309553.635092:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffcd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3302:x1875178210525824:12345-0@lo:400:kworker.0 Request processed in 31us (2345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309553.635098:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788309553.635110:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788309553.635116:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffcda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3300:x1875178210526080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309553.635142:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffcda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3300:x1875178210526080:12345-0@lo:400:kworker.0 Request processed in 27us (2165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309553.635148:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788309553.635254:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffcd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875178210525696:0@lo:400:kworker.0 00000100:00100000:0.0:1788309553.635267:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffcdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875178210525568:0@lo:400:kworker.0 00000100:00100000:0.0:1788309553.635299:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffcd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210526080:0@lo:400:kworker.0 00000100:00080000:0.0:1788309553.635346:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788309553.635351:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788309553.635369:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffcda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3302:1875178210525440:0@lo:400:kworker.0 00000100:00100000:0.0:1788309553.635462:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffcdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875178210525952:0@lo:400:kworker.0 00000100:00100000:0.0:1788309553.635473:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffcdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875178210525824:0@lo:400:kworker.0 00000040:00080000:3.0:1788309553.775829:0:12042:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788309553.775839:0:12042:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788309553.775872:0:12042:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788309553.775877:0:12042:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788309553.888504:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788309553.971687:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309553.972270:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192678016 00000100:00100000:2.0:1788309553.972305:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192678016 00000100:00100000:2.0:1788309553.972358:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 84 00000100:00100000:2.0:1788309553.972369:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f5241880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+17:10453:x1875178192678016:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:2.0:1788309553.972406:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309553.972429:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4628c20 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146aacc expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309553.972797:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8a00/0x63a04852f4628c27 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309553.972812:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8a00/0x63a04852f4628c27 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309553.972823:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8a00/0x63a04852f4628c27 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788309553.972840:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:2.0:1788309553.973008:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4628c20 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aacc expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309553.973026:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8a00/0x63a04852f4628c27 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aacc expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309553.973049:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97c8d832f400) 00010000:00010000:2.0:1788309553.973052:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788309553.973056:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8e26d8a00, rc 0) 00000100:00100000:2.0:1788309553.973117:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f5241880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+19:10453:x1875178192678016:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 750us (1440us total) trans 4294967363 rc 0/0 00000100:00100000:2.0:1788309553.973125:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 84 00000100:00100000:0.0:1788309553.977467:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309553.977656:0:8305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192678144 00000100:00100000:2.0:1788309553.977666:0:8305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192678144 00000100:00100000:2.0:1788309553.977727:0:8305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 85 00000100:00100000:2.0:1788309553.977737:0:8305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffcdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+19:10453:x1875178192678144:12345-192.168.202.55@tcp:34:lfs.0 00010000:00010000:2.0:1788309553.977827:0:8305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628c35 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309553.977845:0:8305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628c35 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309553.977857:0:8305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628c35 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309553.977872:0:8305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628c3c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309553.977888:0:8305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628c3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309553.977895:0:8305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628c3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309553.978188:0:8305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4628c43 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309553.978197:0:8305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4628c43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309553.978204:0:8305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4628c43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788309553.978241:0:8305:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4628c43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309553.978253:0:8305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628c35 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309553.978260:0:8305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628c35 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309553.978267:0:8305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628c35 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309553.978273:0:8305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d8000 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309553.978293:0:8305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628c35 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309553.978302:0:8305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628c35 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309553.978320:0:8305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97c8d832f400) 00010000:00010000:2.0:1788309553.978322:0:8305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788309553.978327:0:8305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628c35 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309553.978334:0:8305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628c35 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309553.978348:0:8305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628c3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309553.978354:0:8305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628c3c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309553.978360:0:8305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628c3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309553.978365:0:8305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d8e00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309553.978368:0:8305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628c3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309553.978374:0:8305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628c3c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309553.978380:0:8305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97c8d83f4600) 00010000:00010000:2.0:1788309553.978383:0:8305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788309553.978385:0:8305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628c3c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309553.978403:0:8305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628c3c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309553.978428:0:8305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4628c43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309553.978434:0:8305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4628c43 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309553.978440:0:8305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4628c43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309553.978446:0:8305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d8c00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309553.978448:0:8305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4628c43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309553.978454:0:8305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4628c43 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309553.978462:0:8305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c8d83f4700) 00010000:00010000:2.0:1788309553.978464:0:8305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788309553.978467:0:8305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4628c43 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309553.978472:0:8305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4628c43 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309553.979909:0:8305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffcdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+19:10453:x1875178192678144:12345-192.168.202.55@tcp:34:lfs.0 Request processed in 2165us (2444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309553.979921:0:8305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 85 00000100:00100000:2.0:1788309554.030036:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309554.030149:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192678400 00000100:00100000:0.0:1788309554.030160:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192678400 00000100:00100000:0.0:1788309554.030250:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 86 00000100:00100000:0.0:1788309554.030261:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f5245180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+19:10456:x1875178192678400:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:0.0:1788309554.030318:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788309554.030339:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ee00/0x63a04852f4628c4a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146aad3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.030513:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4628c51 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.030545:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4628c51 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.030558:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4628c51 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.030574:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628c58 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.030581:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628c58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.030588:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628c58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788309554.030624:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788309554.030954:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628c5f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.030964:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628c5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.030971:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628c5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788309554.030980:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1788309554.031271:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4628c51 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.031317:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4628c51 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.031323:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4628c51 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.031337:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8c153a000 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:3.0:1788309554.031341:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4628c51 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.031348:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4628c51 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.031360:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97c8d832f400) 00010000:00010000:3.0:1788309554.031363:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788309554.031368:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4628c51 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.031373:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4628c51 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.031386:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628c58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.031405:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628c58 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.031410:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628c58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.031415:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8c153ac00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:3.0:1788309554.031418:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628c58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.031424:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628c58 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.031442:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97c8e2544b00) 00010000:00010000:3.0:1788309554.031445:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788309554.031448:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628c58 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.031453:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628c58 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.031563:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ee00/0x63a04852f4628c4a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aad3 expref: 22 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.031582:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628c5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aad3 expref: 21 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.031589:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c8e2544600) 00010000:00010000:3.0:1788309554.031591:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788309554.031593:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8c153a200, rc 0) 00000100:00100000:3.0:1788309554.031653:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f5245180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+21:10456:x1875178192678400:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 1394us (1627us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1788309554.031662:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 86 00000100:00100000:0.0:1788309554.035803:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309554.035924:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192678528 00000100:00100000:1.0:1788309554.035934:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192678528 00000100:00100000:1.0:1788309554.036002:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 87 00000100:00100000:1.0:1788309554.036014:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffcdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+21:10456:x1875178192678528:12345-192.168.202.55@tcp:54:lfs.0 00010000:00010000:1.0:1788309554.036103:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549000/0x63a04852f4628c6d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.036121:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549000/0x63a04852f4628c6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.036141:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549000/0x63a04852f4628c6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.036172:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549000/0x63a04852f4628c6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.036180:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549000/0x63a04852f4628c6d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.036187:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549000/0x63a04852f4628c6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.036194:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8f5549000 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:1.0:1788309554.036199:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549000/0x63a04852f4628c6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.036207:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549000/0x63a04852f4628c6d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.036219:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c8e2544600) 00010000:00010000:1.0:1788309554.036222:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788309554.036242:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549000/0x63a04852f4628c6d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.036249:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549000/0x63a04852f4628c6d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309554.036372:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffcdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+21:10456:x1875178192678528:12345-192.168.202.55@tcp:54:lfs.0 Request processed in 359us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309554.036381:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 87 00000100:00100000:0.0:1788309554.041312:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309554.041425:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192678784 00000100:00100000:1.0:1788309554.041441:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192678784 00000100:00100000:3.0:1788309554.041560:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 21 00000100:00100000:3.0:1788309554.041580:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6639850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+21:10456:x1875178192678784:12345-192.168.202.55@tcp:35:lfs.0 00000100:00100000:3.0:1788309554.041963:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6639850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+22:10456:x1875178192678784:12345-192.168.202.55@tcp:35:lfs.0 Request processed in 390us (692us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1788309554.041972:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 21 00000100:00100000:2.0:1788309554.085733:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309554.085847:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192679040 00000100:00100000:3.0:1788309554.085874:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192679040 00000100:00100000:3.0:1788309554.085942:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 88 00000100:00100000:3.0:1788309554.085951:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f5246680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+22:9977:x1875178192679040:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:3.0:1788309554.085981:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309554.086011:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628c74 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146aada expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.086134:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4628c7b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.086147:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628c5f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aad3 expref: 23 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.086154:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4628c7b lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.086188:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628c5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aad3 expref: 23 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.086200:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628c5f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aad3 expref: 23 pid: 5838 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309554.086213:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc91d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1875178210526208:192.168.202.55@tcp:104: 00000100:00100000:3.0:1788309554.086377:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8e6bc1840 going to sleep for 11 seconds 00000100:00100000:2.0:1788309554.092949:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309554.093128:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192679168 00000100:00100000:1.0:1788309554.093157:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192679168 00010000:00010000:1.0:1788309554.093216:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628c5f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aad3 expref: 24 pid: 5838 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309554.093230:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc91d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1875178210526208:192.168.202.55@tcp:104: 00000100:00100000:1.0:1788309554.093272:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 47 00010000:00010000:3.0:1788309554.093314:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4628c7b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309554.093328:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f5244380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+24:2350:x1875178192679168:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788309554.093344:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788309554.093352:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628c5f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aad3 expref: 24 pid: 5838 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.093366:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628c5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aad3 expref: 24 pid: 5838 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.093399:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628c5f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aad3 expref: 24 pid: 5838 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.093419:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c8e2544600) 00010000:00010000:1.0:1788309554.093438:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4628c7b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.093449:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4628c7b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.093456:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4628c7b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.093491:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788309554.093555:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f5244380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+23:2350:x1875178192679168:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 234us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309554.093563:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 47 00010000:00010000:3.0:1788309554.095978:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4628c7b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.096018:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4628c7b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788309554.096049:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1788309554.096262:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628c74 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aada expref: 24 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.096339:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4628c7b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aada expref: 23 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.096351:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c8e2544600) 00010000:00010000:3.0:1788309554.096355:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788309554.096358:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8c153a000, rc 0) 00000100:00100000:3.0:1788309554.096452:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f5246680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+23:9977:x1875178192679040:12345-192.168.202.55@tcp:101:bash.0 Request processed in 10499us (10727us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1788309554.096461:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 88 00000100:00100000:2.0:1788309554.106830:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309554.107429:0:8305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192679424 00000100:00100000:0.0:1788309554.107446:0:8305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192679424 00000100:00100000:0.0:1788309554.107768:0:8305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 89 00000100:00100000:0.0:1788309554.107784:0:8305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f5245880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+23:9977:x1875178192679424:12345-192.168.202.55@tcp:36:bash.0 00010000:00010000:0.0:1788309554.108125:0:8305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f400/0x63a04852f4628c89 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309554.108143:0:8305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f400/0x63a04852f4628c89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309554.108174:0:8305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f400/0x63a04852f4628c89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788309554.108232:0:8305:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:0.0:1788309554.108262:0:8305:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ac0ac916 reply state 00000000918936d9 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f400/0x63a04852f4628c89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309554.108273:0:8305:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1788309554.108434:0:8305:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:0.0:1788309554.108585:0:8305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f5245880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+27:9977:x1875178192679424:12345-192.168.202.55@tcp:36:bash.0 Request processed in 805us (1767us total) trans 4294967369 rc 0/0 00000100:00100000:0.0:1788309554.108592:0:8305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 89 00000020:00080000:0.0:1788309554.108597:0:8305:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:2.0:1788309554.111671:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f400/0x63a04852f4628c89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.111696:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f400/0x63a04852f4628c89 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.111710:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f400/0x63a04852f4628c89 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.111717:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8ecf2f400 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309554.111723:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f400/0x63a04852f4628c89 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.111731:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f400/0x63a04852f4628c89 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.111758:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c8e2544600) 00010000:00010000:2.0:1788309554.111762:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788309554.111768:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f400/0x63a04852f4628c89 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.111775:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f400/0x63a04852f4628c89 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309554.112629:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309554.112841:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192679552 00000100:00100000:1.0:1788309554.112856:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192679552 00000100:00100000:1.0:1788309554.112938:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 90 00000100:00100000:1.0:1788309554.112951:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f5247800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+26:9977:x1875178192679552:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:1.0:1788309554.112985:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788309554.113013:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628c90 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146aae1 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.113094:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628c90 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aae1 expref: 27 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.113110:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628c90 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aae1 expref: 27 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.113133:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c8e2544600) 00010000:00010000:1.0:1788309554.113136:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788309554.113159:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8f5548e00, rc 0) 00000100:00100000:1.0:1788309554.113321:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f5247800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+27:9977:x1875178192679552:12345-192.168.202.55@tcp:101:bash.0 Request processed in 372us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309554.113329:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 90 00000100:00100000:0.0:1788309554.117233:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309554.117310:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309554.117334:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309554.117420:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309554.117449:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309554.117488:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192679936 00000100:00100000:0.0:1788309554.117488:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192679680 00000100:00100000:1.0:1788309554.117500:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192679936 00000100:00100000:0.0:1788309554.117500:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192679680 00000100:00100000:2.0:1788309554.117575:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192680064 00000100:00100000:2.0:1788309554.117580:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192680064 00000100:00100000:1.0:1788309554.117582:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 73 00000100:00100000:1.0:1788309554.117596:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffcd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+7:2351:x1875178192679936:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:2.0:1788309554.117602:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 74 00000100:00100000:2.0:1788309554.117608:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffcd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+7:2351:x1875178192680064:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788309554.117701:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffcd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+7:2351:x1875178192679936:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 108us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309554.117710:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 73 00000100:00100000:3.0:1788309554.117804:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192680192 00000100:00100000:3.0:1788309554.117810:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192680192 00000100:00100000:2.0:1788309554.117849:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffcd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+7:2351:x1875178192680064:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 241us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309554.117857:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 74 00000100:00100000:2.0:1788309554.117882:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192679808 00000100:00100000:2.0:1788309554.117886:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192679808 00000100:00100000:2.0:1788309554.117911:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 288 00000100:00100000:2.0:1788309554.117917:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8351692-8d1a-4b41-bdaf-bf179786ff59+13:2351:x1875178192679808:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:2.0:1788309554.117942:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8351692-8d1a-4b41-bdaf-bf179786ff59+13:2351:x1875178192679808:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 25us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309554.117948:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 288 00000100:00100000:0.0:1788309554.118093:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 33 00000100:00100000:0.0:1788309554.118101:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffcda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:9977:x1875178192679680:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:0.0:1788309554.118114:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788309554.118144:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca4db15a/0x63a04852f4628c97 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146aae8 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788309554.118177:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a97702e, atime: 0x6a97702c, ctime: 0x6a97702e, blocks: 0xb 00010000:00010000:0.0:1788309554.118199:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=316s v=(0 0) 00010000:00010000:0.0:1788309554.118214:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788309554.118224:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca4db15a/0x63a04852f4628c97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aae8 expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309554.118246:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ca4db15a/0x63a04852f4628c97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aae8 expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309554.118264:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8ecf2ec00, rc 0) 00000100:00100000:0.0:1788309554.118315:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffcda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+7:9977:x1875178192679680:12345-192.168.202.55@tcp:101:bash.0 Request processed in 215us (1098us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309554.118321:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 33 00000100:00080000:1.0:1788309554.121156:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788309554.121170:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788309554.121174:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788309554.121238:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 133 00000100:00100000:3.0:1788309554.121255:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffcdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ea7f0717-c12d-4408-bdfd-5a035f695b73+5:2351:x1875178192680192:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788309554.121711:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffcdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ea7f0717-c12d-4408-bdfd-5a035f695b73+5:2351:x1875178192680192:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 459us (4371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309554.121721:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 133 00000100:00100000:0.0:1788309554.121999:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309554.122198:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192680320 00000100:00100000:1.0:1788309554.122209:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192680320 00002000:00010000:1.0:1788309554.122257:0:6686:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:1.0:1788309554.122262:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97c8e6585880 with x1875178192680320 ext(0->18446744073709551615) 00002000:00010000:1.0:1788309554.122296:0:6686:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97c8e6585880. 00000100:00100000:1.0:1788309554.122331:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 1 00000100:00100000:1.0:1788309554.122340:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6585880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+7:2350:x1875178192680320:12345-192.168.202.55@tcp:10:bash.0 00002000:00010000:1.0:1788309554.123523:0:6686:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1788309554.123534:0:6686:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1788309550 -> 1788309554 00002000:00010000:1.0:1788309554.123537:0:6686:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1788309548 -> 1788309548 00002000:00010000:1.0:1788309554.123540:0:6686:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788309550 -> 1788309554 00002000:00010000:1.0:1788309554.123542:0:6686:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1788309554.123663:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6585880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+8:2350:x1875178192680320:12345-192.168.202.55@tcp:10:bash.0 Request processed in 1320us (1661us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788309554.123678:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 1 00002000:00010000:1.0:1788309554.123683:0:6686:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:1.0:1788309554.123686:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97c8e6585880 with x1875178192680320 ext(0->18446744073709551615) 00002000:00010000:1.0:1788309554.123694:0:6686:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97c8e6585880. 00000100:00100000:2.0:1788309554.144715:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e6584a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210526336:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788309554.144828:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309554.149342:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210526336 00000100:00100000:0.0:1788309554.149364:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210526336 00000100:00100000:0.0:1788309554.149670:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788309554.149684:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8efc4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1875178210526336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788309554.149749:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788309554.149869:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8efc4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1875178210526336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 187us (5039us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309554.149878:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788309554.149950:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e6584a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210526336:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788309554.158350:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788309554.184357:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309554.184672:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192680448 00000100:00100000:1.0:1788309554.184686:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192680448 00000100:00100000:1.0:1788309554.184898:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 91 00000100:00100000:1.0:1788309554.184911:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc91d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+27:10471:x1875178192680448:12345-192.168.202.55@tcp:34:lfs.0 00010000:00010000:1.0:1788309554.185021:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548600/0x63a04852f4628c9e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.185045:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548600/0x63a04852f4628c9e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.185059:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548600/0x63a04852f4628c9e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.185079:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548c00/0x63a04852f4628ca5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.185087:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548c00/0x63a04852f4628ca5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.185094:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548c00/0x63a04852f4628ca5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.185579:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628cac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.185591:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628cac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.185607:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628cac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788309554.185660:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628cac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.185674:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548600/0x63a04852f4628c9e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.185680:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548600/0x63a04852f4628c9e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.185687:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548600/0x63a04852f4628c9e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.186149:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8f5548600 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:1.0:1788309554.186154:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548600/0x63a04852f4628c9e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.186164:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548600/0x63a04852f4628c9e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.186181:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97c8d832f400) 00010000:00010000:1.0:1788309554.186184:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788309554.186190:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548600/0x63a04852f4628c9e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.186197:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548600/0x63a04852f4628c9e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.186217:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548c00/0x63a04852f4628ca5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.186232:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548c00/0x63a04852f4628ca5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.186239:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548c00/0x63a04852f4628ca5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.186245:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8f5548c00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:1.0:1788309554.186249:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548c00/0x63a04852f4628ca5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.186256:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548c00/0x63a04852f4628ca5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.186265:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97c8d832ff00) 00010000:00010000:1.0:1788309554.186268:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788309554.186271:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548c00/0x63a04852f4628ca5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.186328:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548c00/0x63a04852f4628ca5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.186355:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628cac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.186362:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628cac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.186956:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628cac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.186969:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8f5548000 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:1.0:1788309554.186983:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628cac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.186991:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628cac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.187003:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c8e2544600) 00010000:00010000:1.0:1788309554.187006:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788309554.187010:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628cac lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.187017:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628cac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309554.187944:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc91d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+27:10471:x1875178192680448:12345-192.168.202.55@tcp:34:lfs.0 Request processed in 3021us (3589us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309554.187962:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 91 00000001:00080000:0.0:1788309554.230774:0:6706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00080000:0.0:1788309554.230792:0:6706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:0.0:1788309554.241574:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309554.241733:0:8305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192680704 00000100:00100000:2.0:1788309554.241744:0:8305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192680704 00000100:00100000:2.0:1788309554.241816:0:8305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 92 00000100:00100000:2.0:1788309554.241829:0:8305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6584a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+27:10474:x1875178192680704:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:2.0:1788309554.241854:0:8305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309554.241876:0:8305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628cb3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146aaef expref: -99 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.241955:0:8305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628cba lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.241970:0:8305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628cba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.241999:0:8305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628cba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.242015:0:8305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4628cc1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.242022:0:8305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4628cc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.242028:0:8305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4628cc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.242421:0:8305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4628cc8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.242431:0:8305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4628cc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.242439:0:8305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4628cc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788309554.242449:0:8305:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788309554.242541:0:8305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628cba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.242548:0:8305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628cba lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.242554:0:8305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628cba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.242560:0:8305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d8000 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309554.242571:0:8305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628cba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.242579:0:8305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628cba lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.242591:0:8305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97c8d832f400) 00010000:00010000:2.0:1788309554.242595:0:8305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788309554.242599:0:8305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628cba lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.242604:0:8305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628cba lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.242616:0:8305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4628cc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.242622:0:8305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4628cc1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.242627:0:8305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4628cc1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.242632:0:8305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d8800 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309554.242635:0:8305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4628cc1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.242640:0:8305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4628cc1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.242647:0:8305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97c8d83f4700) 00010000:00010000:2.0:1788309554.242649:0:8305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788309554.242658:0:8305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4628cc1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.242663:0:8305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4628cc1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.242710:0:8305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628cb3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aaef expref: 30 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.242725:0:8305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4628cc8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aaef expref: 29 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.242732:0:8305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c8e2544600) 00010000:00010000:2.0:1788309554.242734:0:8305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788309554.242737:0:8305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8e26d8600, rc 0) 00000100:00100000:2.0:1788309554.242808:0:8305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6584a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+29:10474:x1875178192680704:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 982us (1246us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1788309554.242816:0:8305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 92 00000100:00100000:0.0:1788309554.250604:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309554.250710:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192680832 00000100:00100000:3.0:1788309554.250722:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192680832 00000100:00100000:3.0:1788309554.250837:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 93 00000100:00100000:3.0:1788309554.250848:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6585180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+29:10474:x1875178192680832:12345-192.168.202.55@tcp:54:lfs.0 00010000:00010000:3.0:1788309554.250938:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628cd6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.250956:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4628c7b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aada expref: 29 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.250967:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628cd6 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.251004:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4628c7b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aada expref: 29 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.251018:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4628c7b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aada expref: 29 pid: 5838 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309554.251032:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc91ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1875178210526464:192.168.202.55@tcp:104: 00000100:00100000:3.0:1788309554.251126:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8e6bc1d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788309554.258883:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309554.259244:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192681088 00000100:00100000:1.0:1788309554.259256:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192681088 00000100:00100000:3.0:1788309554.259612:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc91ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1875178210526464:192.168.202.55@tcp:104: 00000100:00100000:1.0:1788309554.259637:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 22 00010000:00010000:3.0:1788309554.259664:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628cd6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309554.259664:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6585f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+30:5589:x1875178192681088:12345-192.168.202.55@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788309554.263700:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6585f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+31:5589:x1875178192681088:12345-192.168.202.55@tcp:35:ldlm_bl.0 Request processed in 4040us (4816us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1788309554.263713:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 22 00000100:00100000:0.0:1788309554.268235:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309554.268339:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192681216 00000100:00100000:3.0:1788309554.268357:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192681216 00010000:00010000:3.0:1788309554.268428:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4628c7b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aada expref: 31 pid: 5838 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309554.268491:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 48 00000100:00100000:3.0:1788309554.268530:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6584e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+31:2350:x1875178192681216:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788309554.268551:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788309554.268560:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4628c7b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aada expref: 31 pid: 5838 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.268575:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4628c7b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aada expref: 31 pid: 5838 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.268618:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4628c7b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aada expref: 31 pid: 5838 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.268639:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c8e2544600) 00010000:00010000:3.0:1788309554.268643:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628cd6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.268652:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628cd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.268659:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628cd6 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.268700:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788309554.268746:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628cd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309554.268760:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628cd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309554.268786:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6584e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+30:2350:x1875178192681216:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 258us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309554.268793:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 48 00010000:00010000:0.0:1788309554.268812:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628cd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309554.268824:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628cd6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309554.268832:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628cd6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309554.268840:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8c153ac00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:0.0:1788309554.268844:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628cd6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309554.268852:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628cd6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309554.268870:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c8e2544600) 00010000:00010000:0.0:1788309554.268873:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788309554.268878:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628cd6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309554.268883:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628cd6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309554.268975:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6585180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+29:10474:x1875178192680832:12345-192.168.202.55@tcp:54:lfs.0 Request processed in 18126us (18379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309554.269000:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 93 00000100:00100000:1.0:1788309554.271987:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309554.272097:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192681472 00000100:00100000:2.0:1788309554.272109:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192681472 00000100:00100000:2.0:1788309554.272189:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 23 00000100:00100000:2.0:1788309554.272200:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f5243480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+29:10474:x1875178192681472:12345-192.168.202.55@tcp:35:lfs.0 00000100:00100000:2.0:1788309554.272567:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f5243480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+30:10474:x1875178192681472:12345-192.168.202.55@tcp:35:lfs.0 Request processed in 367us (590us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1788309554.272577:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 23 00000100:00100000:1.0:1788309554.375720:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309554.377356:0:8305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192681728 00000100:00100000:2.0:1788309554.377377:0:8305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192681728 00000100:00100000:2.0:1788309554.377493:0:8305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 94 00000100:00100000:2.0:1788309554.377508:0:8305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f5243b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+30:10485:x1875178192681728:12345-192.168.202.55@tcp:101:cat.0 00010000:00010000:2.0:1788309554.377570:0:8305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309554.377600:0:8305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628cdd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146aaf6 expref: -99 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.377707:0:8305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4628ce4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.377727:0:8305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4628ce4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.377740:0:8305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4628ce4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.377759:0:8305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628ceb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.377767:0:8305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628ceb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.377775:0:8305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628ceb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.378189:0:8305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9600/0x63a04852f4628cf2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.378200:0:8305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9600/0x63a04852f4628cf2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.378207:0:8305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9600/0x63a04852f4628cf2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788309554.378218:0:8305:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:2.0:1788309554.378428:0:8305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4628ce4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.378436:0:8305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4628ce4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.378443:0:8305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4628ce4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.378450:0:8305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d8800 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309554.378455:0:8305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4628ce4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.378463:0:8305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4628ce4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.378478:0:8305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97c8d832f400) 00010000:00010000:2.0:1788309554.378481:0:8305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788309554.378486:0:8305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4628ce4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.378494:0:8305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4628ce4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.378512:0:8305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628ceb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.378518:0:8305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628ceb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.378524:0:8305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628ceb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.378530:0:8305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d8000 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309554.378539:0:8305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628ceb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.378547:0:8305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628ceb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.378555:0:8305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97c8d83f4700) 00010000:00010000:2.0:1788309554.378557:0:8305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788309554.378560:0:8305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628ceb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.378566:0:8305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628ceb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.378621:0:8305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628cdd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aaf6 expref: 33 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.378637:0:8305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9600/0x63a04852f4628cf2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aaf6 expref: 32 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.378645:0:8305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c8e2544600) 00010000:00010000:2.0:1788309554.378647:0:8305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788309554.378650:0:8305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8e26d9600, rc 0) 00000100:00100000:2.0:1788309554.379855:0:8305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f5243b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+32:10485:x1875178192681728:12345-192.168.202.55@tcp:101:cat.0 Request processed in 2338us (4139us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1788309554.379871:0:8305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 94 00000100:00100000:0.0:1788309554.384875:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309554.388897:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192681984 00000100:00100000:2.0:1788309554.388922:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192681984 00000100:00100000:2.0:1788309554.389029:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 24 00000100:00100000:2.0:1788309554.389043:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6587100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+32:10485:x1875178192681984:12345-192.168.202.55@tcp:35:cat.0 00000100:00100000:2.0:1788309554.389525:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6587100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+33:10485:x1875178192681984:12345-192.168.202.55@tcp:35:cat.0 Request processed in 480us (4660us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1788309554.389536:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 24 00000100:00100000:1.0:1788309554.417504:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309554.417655:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192682240 00000100:00100000:2.0:1788309554.417669:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192682240 00000100:00100000:2.0:1788309554.417748:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 95 00000100:00100000:2.0:1788309554.417762:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f524c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+33:10486:x1875178192682240:12345-192.168.202.55@tcp:36:rm.0 00010000:00010000:2.0:1788309554.417841:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788309554.417892:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9600/0x63a04852f4628cf2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aaf6 expref: 33 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.417921:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4628cc8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aaef expref: 32 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.417936:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628c90 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aae1 expref: 31 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.417950:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c8e2544600) 00010000:00010000:2.0:1788309554.417966:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788309554.417994:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628d00 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.418010:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628d00 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.418020:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628d00 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.418050:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628d07 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.418058:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628d07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.418065:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628d07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.419053:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4628d0e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.419071:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4628d0e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.419080:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4628d0e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788309554.420186:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:2.0:1788309554.420203:0:5839:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 317170924675ns, next at 318170920036ns, rc = 0 00010000:00010000:2.0:1788309554.420423:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628d15 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.420444:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628d15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.420457:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628d15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.420466:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628d15 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.420487:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628d15 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.420494:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628d15 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.420603:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788309554.420655:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4628d0e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.420661:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4628d0e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.420668:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4628d0e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.420675:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d8800 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309554.420681:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4628d0e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.420690:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4628d0e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.420709:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c8d83f4600) 00010000:00010000:2.0:1788309554.420712:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788309554.420720:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4628d0e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.420725:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4628d0e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.420750:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628d00 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.420762:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628d00 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.420768:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628d00 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.420774:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d8e00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309554.420777:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628d00 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.420783:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628d00 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.420791:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97c8d832f400) 00010000:00010000:2.0:1788309554.420794:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788309554.420798:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628d00 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.420803:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628d00 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788309554.420816:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b6f1b4d7 reply state 00000000fefef205 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628d07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309554.420829:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788309554.420964:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f524c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+32:10486:x1875178192682240:12345-192.168.202.55@tcp:36:rm.0 Request processed in 3199us (3468us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1788309554.420975:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 95 00010000:00010000:1.0:1788309554.421994:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788309554.422008:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628d15 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.422032:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d9c00 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:1.0:1788309554.422036:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628d15 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.422044:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628d15 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.422058:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c8d83f4600) 00010000:00010000:1.0:1788309554.422060:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788309554.422064:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628d15 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.422069:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628d15 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.422091:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309554.422093:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309554.422095:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309554.426819:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628d07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.426883:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628d07 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.426893:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628d07 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.426901:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d8000 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309554.426907:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628d07 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.426917:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628d07 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.426940:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97c8d83f4700) 00010000:00010000:2.0:1788309554.426943:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788309554.426948:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628d07 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.426955:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628d07 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309554.497083:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309554.497262:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192682496 00000100:00100000:3.0:1788309554.497402:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192682496 00000100:00100000:3.0:1788309554.497758:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 96 00000100:00100000:3.0:1788309554.497771:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f524e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+31:10492:x1875178192682496:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:3.0:1788309554.497827:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309554.497860:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4628d1c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146aafd expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.498064:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628d23 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.498084:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628d23 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.498098:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628d23 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.498117:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628d2a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.498124:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628d2a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.498129:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628d2a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788309554.502157:0:5837:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:3.0:1788309554.502665:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4628d31 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.502688:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4628d31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.502704:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4628d31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.503054:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628d23 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.503064:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628d23 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.503073:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628d23 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.503079:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8c153ac00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:3.0:1788309554.503085:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628d23 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.503093:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628d23 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.503110:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97c8d832f400) 00010000:00010000:3.0:1788309554.503113:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788309554.503120:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628d23 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.503127:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628d23 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788309554.503147:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000172fb97e reply state 0000000069b0d020 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628d2a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309554.503159:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788309554.503208:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4628d1c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aafd expref: 34 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.503241:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4628d31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aafd expref: 33 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.503249:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97c8e2544500) 00010000:00010000:3.0:1788309554.503252:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788309554.503255:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8c153bc00, rc 0) 00000100:00100000:3.0:1788309554.503498:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f524e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+34:10492:x1875178192682496:12345-192.168.202.55@tcp:101:bash.0 Request processed in 5729us (6432us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1788309554.503510:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 96 00010000:00010000:2.0:1788309554.506335:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628d2a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.506360:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628d2a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.506369:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628d2a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.506377:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8c153a200 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309554.506412:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628d2a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.506421:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628d2a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.506443:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97c8e2544b00) 00010000:00010000:2.0:1788309554.506447:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788309554.506453:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628d2a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.506459:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628d2a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309554.507329:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309554.507703:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192682624 00000100:00100000:2.0:1788309554.507715:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192682624 00000100:00100000:2.0:1788309554.507809:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 34 00000100:00100000:2.0:1788309554.507822:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc502850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+5:2352:x1875178192682624:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:2.0:1788309554.507849:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309554.507880:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfa15baf/0x63a04852f4628d3f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ab04 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788309554.508149:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788309554.508178:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=317s v=(0 0) 00010000:00010000:2.0:1788309554.508184:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788309554.508197:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfa15baf/0x63a04852f4628d3f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab04 expref: 6 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.508221:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bfa15baf/0x63a04852f4628d3f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab04 expref: 6 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.508255:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8e26d8e00, rc 0) 00000100:00100000:2.0:1788309554.510005:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc502850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:2352:x1875178192682624:12345-192.168.202.55@tcp:101:bash.0 Request processed in 2172us (2671us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309554.510018:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 34 00000100:00100000:1.0:1788309554.515825:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309554.515944:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192682752 00000100:00100000:2.0:1788309554.515959:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192682752 00000100:00100000:2.0:1788309554.516135:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 35 00000100:00100000:2.0:1788309554.516149:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f524dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:10492:x1875178192682752:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:2.0:1788309554.516174:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309554.516199:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9719e6a/0x63a04852f4628d46 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ab0b expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.516239:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bfa15baf/0x63a04852f4628d3f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab04 expref: 7 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.516250:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788309554.516255:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788309554.516262:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9719e6a/0x63a04852f4628d46 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab0b expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.516347:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bfa15baf/0x63a04852f4628d3f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab04 expref: 7 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.516363:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bfa15baf/0x63a04852f4628d3f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab04 expref: 7 pid: 6680 timeout: 417 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309554.516482:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8efc4fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6682:1875178210526592:192.168.202.55@tcp:104: 00000100:00100000:2.0:1788309554.516646:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c3522540 going to sleep for 11 seconds 00000100:00100000:2.0:1788309554.521335:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8efc4fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6682:1875178210526592:192.168.202.55@tcp:104: 00010000:00010000:2.0:1788309554.521469:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e9719e6a/0x63a04852f4628d46 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab0b expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.521570:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8e26d8800, rc 0) 00000100:00100000:2.0:1788309554.521727:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f524dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+7:10492:x1875178192682752:12345-192.168.202.55@tcp:101:bash.0 Request processed in 5580us (5917us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309554.521747:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 35 00000100:00100000:1.0:1788309554.526314:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309554.526525:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192682880 00000100:00100000:2.0:1788309554.526537:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192682880 00010000:00010000:2.0:1788309554.526592:0:8447:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bfa15baf/0x63a04852f4628d3f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab04 expref: 7 pid: 6680 timeout: 417 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309554.526681:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 49 00000100:00100000:2.0:1788309554.526695:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6b28c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+7:2350:x1875178192682880:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788309554.526716:0:8447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788309554.526757:0:8447:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bfa15baf/0x63a04852f4628d3f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab04 expref: 7 pid: 6680 timeout: 417 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.526774:0:8447:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bfa15baf/0x63a04852f4628d3f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab04 expref: 7 pid: 6680 timeout: 417 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.526829:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfa15baf/0x63a04852f4628d3f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab04 expref: 7 pid: 6680 timeout: 417 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.526853:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788309554.526858:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788309554.526868:0:8447:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e9719e6a/0x63a04852f4628d46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab0b expref: 6 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.526881:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9719e6a/0x63a04852f4628d46 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab0b expref: 6 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.526933:0:8447:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e9719e6a/0x63a04852f4628d46 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab0b expref: 6 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309554.526951:0:8447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8efc4fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8447:1875178210526720:192.168.202.55@tcp:105: 00000100:00100000:2.0:1788309554.527055:0:8447:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c3522540 going to sleep for 11 seconds 00000100:00100000:2.0:1788309554.530745:0:8447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8efc4fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8447:1875178210526720:192.168.202.55@tcp:105: 00010000:00010000:2.0:1788309554.530784:0:8447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788309554.530857:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6b28c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:2350:x1875178192682880:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 4163us (4592us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309554.530870:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 49 00000100:00100000:1.0:1788309554.531162:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309554.531256:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192683136 00000100:00100000:2.0:1788309554.531265:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192683136 00000100:00100000:2.0:1788309554.531352:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 25 00000100:00100000:2.0:1788309554.531381:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f524d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+33:10492:x1875178192683136:12345-192.168.202.55@tcp:35:bash.0 00000100:00100000:2.0:1788309554.534128:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f524d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+34:10492:x1875178192683136:12345-192.168.202.55@tcp:35:bash.0 Request processed in 2731us (2951us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1788309554.534144:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 25 00000100:00100000:2.0:1788309554.658005:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788309554.658041:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8f524ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210526848:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788309554.658140:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309554.658597:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210526848 00000100:00100000:1.0:1788309554.658609:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210526848 00000100:00100000:1.0:1788309554.658687:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788309554.658701:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8efc4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210526848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788309554.658900:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788309554.659211:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8efc4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210526848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 510us (1067us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309554.659242:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788309554.668900:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:3.0:1788309554.668920:0:3303:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:3.0:1788309554.668951:0:3303:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97c8ffcab800, transno 4294967301 00000100:00100000:3.0:1788309554.669004:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8f524ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210526848:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788309554.676984:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309554.677124:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192683264 00000100:00100000:0.0:1788309554.677138:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192683264 00000100:00100000:0.0:1788309554.677228:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 97 00000100:00100000:0.0:1788309554.677243:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc91ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+34:10508:x1875178192683264:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:0.0:1788309554.677311:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788309554.677341:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f200/0x63a04852f4628d4d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ab12 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309554.677452:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f600/0x63a04852f4628d54 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309554.677471:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f600/0x63a04852f4628d54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309554.677486:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f600/0x63a04852f4628d54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788309554.677566:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1788309554.677570:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1788309554.677599:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f600/0x63a04852f4628d54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309554.677630:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f200/0x63a04852f4628d4d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab12 expref: 36 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309554.677658:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f600/0x63a04852f4628d54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab12 expref: 35 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309554.677695:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97c8d832f400) 00010000:00010000:0.0:1788309554.677699:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788309554.677704:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8ecf2f600, rc 0) 00000100:00100000:0.0:1788309554.677794:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc91ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+35:10508:x1875178192683264:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 551us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309554.677802:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 97 00000100:00100000:3.0:1788309554.681915:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309554.682068:0:8305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192683520 00000100:00100000:2.0:1788309554.682083:0:8305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192683520 00000100:00100000:2.0:1788309554.682164:0:8305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 98 00000100:00100000:2.0:1788309554.682179:0:8305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc91d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+35:10508:x1875178192683520:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:2.0:1788309554.682207:0:8305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309554.682237:0:8305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628d5b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ab19 expref: -99 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.682433:0:8305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4628d62 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.682451:0:8305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4628d62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.682464:0:8305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4628d62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788309554.682489:0:8305:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788309554.682847:0:8305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628d5b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab19 expref: 38 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.682895:0:8305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4628d62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab19 expref: 37 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.682904:0:8305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97c8e2544500) 00010000:00010000:2.0:1788309554.682907:0:8305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788309554.682912:0:8305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8e26d8600, rc 0) 00000100:00100000:2.0:1788309554.683004:0:8305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc91d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+37:10508:x1875178192683520:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 829us (1105us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1788309554.683013:0:8305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 98 00000100:00100000:1.0:1788309554.687072:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309554.687177:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309554.687266:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192683904 00000100:00100000:3.0:1788309554.687328:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192683904 00000100:00100000:3.0:1788309554.687417:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 6 00000100:00100000:3.0:1788309554.687430:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f524df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+37:2352:x1875178192683904:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788309554.687449:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788309554.687501:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4628d62 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab19 expref: 37 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.687527:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97c8e2544500) 00010000:00010000:3.0:1788309554.687533:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788309554.687616:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f524df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+36:2352:x1875178192683904:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 187us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309554.687625:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 6 00000100:00100000:0.0:1788309554.691489:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192683776 00000100:00100000:0.0:1788309554.691510:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192683776 00000100:00100000:0.0:1788309554.691680:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 99 00000100:00100000:0.0:1788309554.691694:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f524d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+36:10508:x1875178192683776:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:0.0:1788309554.691730:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788309554.691760:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f200/0x63a04852f4628d70 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ab20 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309554.691891:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2fa00/0x63a04852f4628d77 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309554.691909:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2fa00/0x63a04852f4628d77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309554.691924:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2fa00/0x63a04852f4628d77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788309554.691940:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788309554.692105:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f200/0x63a04852f4628d70 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab20 expref: 39 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309554.692158:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2fa00/0x63a04852f4628d77 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab20 expref: 38 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309554.692168:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97c8e2544500) 00010000:00010000:0.0:1788309554.692171:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788309554.692176:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8ecf2fa00, rc 0) 00000100:00100000:0.0:1788309554.692267:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f524d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+38:10508:x1875178192683776:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 575us (5209us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1788309554.692298:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 99 00000100:00100000:1.0:1788309554.697795:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309554.697898:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192684032 00000100:00100000:0.0:1788309554.697915:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192684032 00000100:00100000:0.0:1788309554.698083:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 36 00000100:00100000:0.0:1788309554.698100:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f524ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:2351:x1875178192684032:12345-192.168.202.55@tcp:1:lfs.0 00010000:00010000:0.0:1788309554.698166:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9ad6293/0x63a04852f4628d85 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309554.698195:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e9719e6a/0x63a04852f4628d46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab0b expref: 6 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309554.698205:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788309554.698211:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788309554.698216:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9ad6293/0x63a04852f4628d85 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309554.699010:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e9719e6a/0x63a04852f4628d46 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab0b expref: 6 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309554.699059:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e9719e6a/0x63a04852f4628d46 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab0b expref: 6 pid: 6682 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309554.699078:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e6586d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6681:1875178210526976:192.168.202.55@tcp:104: 00000100:00100000:0.0:1788309554.699271:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d120b600 going to sleep for 11 seconds 00000100:00100000:3.0:1788309554.703490:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309554.703836:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192684160 00000100:00100000:1.0:1788309554.703849:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192684160 00002000:00100000:1.0:1788309554.703921:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff97c8fc91df80 x1875178192684160/t0(0) o4->86451057-f8bb-4d7c-a7c2-5c834b43e3d3@192.168.202.55@tcp:710/0 lens 504/0 e 0 to 0 dl 1788309565 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788309554.703933:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97c8fc91df80 with x1875178192684160 ext(0->8) 00010000:00010000:1.0:1788309554.703945:0:6688:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000e9719e6a/0x63a04852f4628d46 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab0b expref: 7 pid: 6682 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.703965:0:6688:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000e9719e6a/0x63a04852f4628d46 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab0b expref: 7 pid: 6682 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788309554.703974:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff97c8fc91df80 00000100:00100000:1.0:1788309554.704020:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 1 00000100:00100000:1.0:1788309554.704032:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc91df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+7:2351:x1875178192684160:12345-192.168.202.55@tcp:4:lfs.0 00000100:00100000:1.0:1788309554.705252:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc91df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+9:2351:x1875178192684160:12345-192.168.202.55@tcp:4:lfs.0 Request processed in 1212us (1767us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788309554.705266:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 1 00002000:00100000:1.0:1788309554.705305:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff97c8fc91df80 x1875178192684160/t4294967302(0) o4->86451057-f8bb-4d7c-a7c2-5c834b43e3d3@192.168.202.55@tcp:710/0 lens 504/448 e 0 to 0 dl 1788309565 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788309554.705316:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97c8fc91df80 with x1875178192684160 ext(0->8) 00010000:00010000:1.0:1788309554.705327:0:6688:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000e9719e6a/0x63a04852f4628d46 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab0b expref: 9 pid: 6682 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.705360:0:6688:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000e9719e6a/0x63a04852f4628d46 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab0b expref: 9 pid: 6682 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788309554.705369:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff97c8fc91df80 00000100:00100000:0.0:1788309554.705540:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e6586d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6681:1875178210526976:192.168.202.55@tcp:104: 00010000:00010000:0.0:1788309554.705578:0:6681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e9ad6293/0x63a04852f4628d85 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309554.710990:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309554.711111:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192684288 00000100:00100000:3.0:1788309554.711127:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192684288 00010000:00010000:3.0:1788309554.711186:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e9719e6a/0x63a04852f4628d46 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab0b expref: 9 pid: 6682 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309554.711250:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 50 00000100:00100000:3.0:1788309554.711263:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f524f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+9:2351:x1875178192684288:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788309554.711337:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788309554.711366:0:5823:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788309554.711369:0:5823:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788309554 00002000:00010000:3.0:1788309554.711372:0:5823:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788309554 00002000:00010000:3.0:1788309554.711375:0:5823:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788309554 00010000:00010000:3.0:1788309554.711390:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e9719e6a/0x63a04852f4628d46 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab0b expref: 9 pid: 6682 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.711409:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e9719e6a/0x63a04852f4628d46 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab0b expref: 9 pid: 6682 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.711446:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9719e6a/0x63a04852f4628d46 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab0b expref: 9 pid: 6682 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.711471:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788309554.711488:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788309554.711618:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e9ad6293/0x63a04852f4628d85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.711629:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9ad6293/0x63a04852f4628d85 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.711663:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788309554.711829:0:6681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e9ad6293/0x63a04852f4628d85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309554.711840:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9ad6293/0x63a04852f4628d85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309554.711873:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9ad6293/0x63a04852f4628d85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309554.711883:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e9ad6293/0x63a04852f4628d85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309554.711892:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e9ad6293/0x63a04852f4628d85 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309554.711914:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8ecf2e600 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:0.0:1788309554.711919:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9ad6293/0x63a04852f4628d85 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309554.711930:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9ad6293/0x63a04852f4628d85 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309554.711943:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e9ad6293/0x63a04852f4628d85 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309554.711951:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9ad6293/0x63a04852f4628d85 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309554.712094:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f524f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+8:2351:x1875178192684288:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 831us (1117us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309554.712103:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 50 00000100:00100000:0.0:1788309554.712795:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f524ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+7:2351:x1875178192684032:12345-192.168.202.55@tcp:1:lfs.0 Request processed in 14693us (15008us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309554.712807:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 36 00000100:00100000:2.0:1788309554.715457:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309554.715766:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192684544 00000100:00100000:0.0:1788309554.715780:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192684544 00000100:00100000:1.0:1788309554.715960:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 26 00000100:00100000:1.0:1788309554.715974:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6638050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+38:10508:x1875178192684544:12345-192.168.202.55@tcp:35:lfs.0 00000004:00010000:1.0:1788309554.716059:0:5841:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2fa00/0x63a04852f4628d77 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab20 expref: 38 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788309554.716579:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:1.0:1788309554.716626:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:1.0:1788309554.717039:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:1.0:1788309554.717103:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548400/0x63a04852f4628d8c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.717125:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4628d31 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aafd expref: 42 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.717136:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548400/0x63a04852f4628d8c lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.717186:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4628d31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aafd expref: 42 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.717203:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4628d31 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aafd expref: 42 pid: 5837 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309554.717249:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8f524ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5841:1875178210527104:192.168.202.55@tcp:104: 00000100:00100000:1.0:1788309554.717428:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8e0686840 going to sleep for 11 seconds 00000100:00100000:1.0:1788309554.720925:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309554.721079:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8f524ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5841:1875178210527104:192.168.202.55@tcp:104: 00010000:00010000:2.0:1788309554.721124:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548400/0x63a04852f4628d8c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309554.726272:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192684672 00000100:00100000:3.0:1788309554.726338:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192684672 00010000:00010000:3.0:1788309554.726422:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4628d31 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aafd expref: 43 pid: 5837 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309554.726483:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 51 00000100:00100000:3.0:1788309554.726504:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f524e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+43:2351:x1875178192684672:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788309554.726523:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788309554.726531:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4628d31 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aafd expref: 43 pid: 5837 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.726547:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4628d31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aafd expref: 43 pid: 5837 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.726583:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4628d31 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aafd expref: 43 pid: 5837 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.726606:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97c8e2544500) 00010000:00010000:3.0:1788309554.726631:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548400/0x63a04852f4628d8c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.726642:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548400/0x63a04852f4628d8c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.726650:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548400/0x63a04852f4628d8c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.726690:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788309554.726718:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548400/0x63a04852f4628d8c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309554.726729:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548400/0x63a04852f4628d8c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309554.726783:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f524e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+42:2351:x1875178192684672:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 289us (5871us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309554.726793:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 51 00000001:00080000:0.0:1788309554.726910:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1788309554.727195:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:0.0:1788309554.727377:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e6586d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5841:1875178210527232:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788309554.727478:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309554.727517:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d120b240 going to sleep for 11 seconds 00000100:00100000:3.0:1788309554.727843:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210527232 00000100:00100000:3.0:1788309554.727851:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210527232 00000100:00100000:3.0:1788309554.727923:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788309554.727932:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6586680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5841:x1875178210527232:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788309554.728047:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6586680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5841:x1875178210527232:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 116us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309554.728055:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788309554.728161:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e6586d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5841:1875178210527232:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788309554.728809:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:0.0:1788309554.728901:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e6586d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5841:1875178210527360:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788309554.728953:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309554.729073:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d120b600 going to sleep for 11 seconds 00000100:00100000:3.0:1788309554.729131:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210527360 00000100:00100000:3.0:1788309554.729139:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210527360 00000100:00100000:3.0:1788309554.729185:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788309554.729195:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6587480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5841:x1875178210527360:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788309554.729434:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6587480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5841:x1875178210527360:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 240us (480us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1788309554.729442:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788309554.730453:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e6586d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5841:1875178210527360:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788309554.730550:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:0.0:1788309554.730606:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548400/0x63a04852f4628d8c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309554.730616:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548400/0x63a04852f4628d8c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309554.730621:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548400/0x63a04852f4628d8c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309554.730626:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8f5548400 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:0.0:1788309554.730630:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548400/0x63a04852f4628d8c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309554.730635:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548400/0x63a04852f4628d8c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309554.730651:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97c8e2544500) 00010000:00010000:0.0:1788309554.730654:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788309554.730658:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548400/0x63a04852f4628d8c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309554.730678:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548400/0x63a04852f4628d8c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788309554.730878:0:5841:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788309554.730962:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:0.0:1788309554.730973:0:5841:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 317481694940ns, next at 318481692602ns, rc = 0 00000001:00080000:0.0:1788309554.730978:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:0.0:1788309554.731004:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97c8e2544500) 00010000:00010000:0.0:1788309554.731007:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788309554.731013:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2fa00/0x63a04852f4628d77 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab20 expref: 46 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309554.731137:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6638050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+45:10508:x1875178192684544:12345-192.168.202.55@tcp:35:lfs.0 Request processed in 15167us (15695us total) trans 4294967388 rc 0/0 00000100:00100000:0.0:1788309554.731145:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 26 00000020:00080000:0.0:1788309554.731150:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788309554.734469:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309554.734536:0:8305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192684800 00000100:00100000:2.0:1788309554.734549:0:8305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192684800 00000100:00100000:2.0:1788309554.734621:0:8305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 100 00000100:00100000:2.0:1788309554.734636:0:8305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f524f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+45:10508:x1875178192684800:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:2.0:1788309554.734672:0:8305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309554.734704:0:8305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9600/0x63a04852f4628d93 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ab27 expref: -99 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.734790:0:8305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9600/0x63a04852f4628d93 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab27 expref: 46 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.734808:0:8305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9600/0x63a04852f4628d93 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab27 expref: 46 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.734854:0:8305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97c8d83f4100) 00010000:00010000:2.0:1788309554.734857:0:8305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788309554.734863:0:8305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8e26d9600, rc 0) 00000100:00100000:2.0:1788309554.735053:0:8305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f524f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+46:10508:x1875178192684800:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 420us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309554.735061:0:8305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 100 00000100:00100000:3.0:1788309554.740507:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309554.740883:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192685056 00000100:00100000:2.0:1788309554.740898:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192685056 00000100:00100000:2.0:1788309554.741040:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 27 00000100:00100000:2.0:1788309554.741053:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc91ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+46:10508:x1875178192685056:12345-192.168.202.55@tcp:35:lfs.0 00000100:00100000:2.0:1788309554.741679:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc91ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+47:10508:x1875178192685056:12345-192.168.202.55@tcp:35:lfs.0 Request processed in 625us (1184us total) trans 4294967389 rc 0/0 00000100:00100000:2.0:1788309554.741691:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 27 00000100:00100000:3.0:1788309554.809818:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309554.810035:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192685184 00000100:00100000:1.0:1788309554.810048:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192685184 00000100:00100000:1.0:1788309554.810207:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 101 00000100:00100000:1.0:1788309554.810234:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc91f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+47:10518:x1875178192685184:12345-192.168.202.55@tcp:34:lfs.0 00010000:00010000:1.0:1788309554.810551:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628d9a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.810572:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628d9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.810586:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628d9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.810606:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548c00/0x63a04852f4628da1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.810614:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548c00/0x63a04852f4628da1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.810621:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548c00/0x63a04852f4628da1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.810768:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628da8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.810794:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628da8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.810802:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628da8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788309554.810860:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628da8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.810875:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628d9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.810884:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628d9a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.810892:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628d9a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.810898:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8f5548e00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:1.0:1788309554.810903:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628d9a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.810911:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628d9a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.810926:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97c8d832f400) 00010000:00010000:1.0:1788309554.810930:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788309554.810934:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628d9a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.810942:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628d9a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.810965:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548c00/0x63a04852f4628da1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.810972:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548c00/0x63a04852f4628da1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.810978:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548c00/0x63a04852f4628da1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.810984:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8f5548c00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:1.0:1788309554.810987:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548c00/0x63a04852f4628da1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.810994:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548c00/0x63a04852f4628da1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.811003:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97c8d832ff00) 00010000:00010000:1.0:1788309554.811005:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788309554.811008:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548c00/0x63a04852f4628da1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.811014:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548c00/0x63a04852f4628da1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.811030:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628da8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.811036:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628da8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.811042:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628da8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.811054:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8f5548000 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:1.0:1788309554.811057:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628da8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.811063:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628da8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.811070:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97c8d83f4100) 00010000:00010000:1.0:1788309554.811073:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788309554.811076:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628da8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.811082:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628da8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309554.811190:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc91f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+47:10518:x1875178192685184:12345-192.168.202.55@tcp:34:lfs.0 Request processed in 968us (1386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309554.811200:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 101 00000100:00100000:1.0:1788309554.845328:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309554.845513:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192685440 00000100:00100000:3.0:1788309554.845528:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192685440 00000100:00100000:3.0:1788309554.845605:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 102 00000100:00100000:3.0:1788309554.845618:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f524c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+47:10521:x1875178192685440:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:3.0:1788309554.845649:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309554.845680:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f4628daf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ab2e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.845793:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4628db6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.845813:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4628db6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.845825:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4628db6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.845842:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f4628dbd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.845848:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f4628dbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.845855:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f4628dbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.846025:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4628dc4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.846034:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4628dc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.846064:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4628dc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788309554.846077:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788309554.846206:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4628db6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.846214:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4628db6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.846222:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4628db6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.846229:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8d73eee00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:3.0:1788309554.846235:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4628db6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.846242:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4628db6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.846257:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97c8d832f400) 00010000:00010000:3.0:1788309554.846260:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788309554.846266:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4628db6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.846273:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4628db6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.846337:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f4628dbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.846344:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f4628dbd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.846357:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f4628dbd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.846362:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8d73ef200 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:3.0:1788309554.846365:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f4628dbd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.846372:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f4628dbd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.846392:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97c8e2544400) 00010000:00010000:3.0:1788309554.846395:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788309554.846398:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f4628dbd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.846404:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f4628dbd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.846459:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f4628daf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab2e expref: 50 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.846475:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4628dc4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab2e expref: 49 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309554.846482:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97c8d83f4100) 00010000:00010000:3.0:1788309554.846484:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788309554.846487:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8c153bc00, rc 0) 00000100:00100000:3.0:1788309554.846579:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f524c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+49:10521:x1875178192685440:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 963us (1311us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1788309554.846598:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 102 00000100:00100000:3.0:1788309554.855847:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309554.856267:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192685568 00000100:00100000:0.0:1788309554.856466:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192685568 00000100:00100000:1.0:1788309554.858110:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 103 00000100:00100000:1.0:1788309554.858140:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc91ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+49:10521:x1875178192685568:12345-192.168.202.55@tcp:54:lfs.0 00010000:00010000:1.0:1788309554.858267:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628dd2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.858312:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628dd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.858329:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628dd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.858404:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628dd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.858412:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628dd2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.858420:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628dd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.858427:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8f5548000 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:1.0:1788309554.858432:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628dd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.858441:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628dd2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.858457:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97c8d83f4100) 00010000:00010000:1.0:1788309554.858460:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788309554.858466:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628dd2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.858473:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628dd2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309554.858774:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc91ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+49:10521:x1875178192685568:12345-192.168.202.55@tcp:54:lfs.0 Request processed in 647us (2936us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309554.858784:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 103 00000100:00100000:0.0:1788309554.860560:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309554.861032:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192685824 00000100:00100000:2.0:1788309554.861044:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192685824 00000100:00100000:2.0:1788309554.861190:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 28 00000100:00100000:2.0:1788309554.861203:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6585f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+49:10521:x1875178192685824:12345-192.168.202.55@tcp:35:lfs.0 00000100:00100000:2.0:1788309554.861671:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6585f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+50:10521:x1875178192685824:12345-192.168.202.55@tcp:35:lfs.0 Request processed in 469us (1121us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1788309554.861679:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 28 00010000:00010000:0.0:1788309554.912578:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788309554.961838:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309554.962146:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192686080 00000100:00100000:1.0:1788309554.962161:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192686080 00000100:00100000:1.0:1788309554.962256:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 104 00000100:00100000:1.0:1788309554.962348:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc91e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+50:10531:x1875178192686080:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:1.0:1788309554.962484:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788309554.962494:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788309554.962534:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f600/0x63a04852f4628d54 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab12 expref: 50 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.962567:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97c8d832f400) 00010000:00010000:1.0:1788309554.962573:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788309554.962591:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628dd9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ab35 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.962727:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548c00/0x63a04852f4628de0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.962757:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548c00/0x63a04852f4628de0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.962772:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548c00/0x63a04852f4628de0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788309554.962785:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788309554.962951:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628dd9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab35 expref: 52 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.962969:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548c00/0x63a04852f4628de0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab35 expref: 51 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.962978:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97c8d83f4100) 00010000:00010000:1.0:1788309554.962981:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788309554.962992:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8f5548c00, rc 0) 00000100:00100000:1.0:1788309554.963067:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc91e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+51:10531:x1875178192686080:12345-192.168.202.55@tcp:101:bash.0 Request processed in 723us (1246us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1788309554.963075:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 104 00000100:00100000:3.0:1788309554.968267:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309554.968786:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192686336 00000100:00100000:1.0:1788309554.968802:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192686336 00000100:00100000:1.0:1788309554.968887:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 105 00000100:00100000:1.0:1788309554.968901:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc91f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+51:10531:x1875178192686336:12345-192.168.202.55@tcp:36:bash.0 00010000:00010000:1.0:1788309554.969024:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788309554.969062:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548c00/0x63a04852f4628de0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab35 expref: 51 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.969091:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4628dc4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab2e expref: 50 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.969105:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97c8d83f4100) 00010000:00010000:1.0:1788309554.969110:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788309554.969939:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628dee lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.969959:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628dee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.969971:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628dee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788309554.970047:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:1.0:1788309554.970075:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b9084c39 reply state 000000009c973efe transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628dee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309554.970102:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788309554.970248:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc91f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+52:10531:x1875178192686336:12345-192.168.202.55@tcp:36:bash.0 Request processed in 1347us (1993us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1788309554.970257:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 105 00000020:00080000:1.0:1788309554.970264:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788309554.973880:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628dee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.973905:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628dee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.973937:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628dee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.973945:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8f5548e00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309554.973951:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628dee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.973960:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628dee lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.973985:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97c8d83f4100) 00010000:00010000:2.0:1788309554.973988:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788309554.973994:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628dee lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309554.974001:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628dee lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309554.975262:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309554.976113:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192686464 00000100:00100000:1.0:1788309554.976130:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192686464 00000100:00100000:1.0:1788309554.976202:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 106 00000100:00100000:1.0:1788309554.976215:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc91c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+51:10531:x1875178192686464:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:1.0:1788309554.976251:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788309554.976539:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549000/0x63a04852f4628df5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ab3c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.976668:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548600/0x63a04852f4628dfc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.976687:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548600/0x63a04852f4628dfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.976701:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548600/0x63a04852f4628dfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788309554.976739:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788309554.976744:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788309554.976768:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548600/0x63a04852f4628dfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.976804:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549000/0x63a04852f4628df5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab3c expref: 53 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.976853:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548600/0x63a04852f4628dfc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab3c expref: 52 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309554.976863:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97c8d83f4100) 00010000:00010000:1.0:1788309554.976867:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788309554.976871:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8f5548600, rc 0) 00000100:00100000:1.0:1788309554.976956:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc91c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+52:10531:x1875178192686464:12345-192.168.202.55@tcp:101:bash.0 Request processed in 743us (1706us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309554.976964:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 106 00000100:00100000:3.0:1788309554.982692:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309554.983130:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192686720 00000100:00100000:2.0:1788309554.983146:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192686720 00000100:00100000:2.0:1788309554.983265:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 29 00000100:00100000:2.0:1788309554.983875:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc91ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+52:10531:x1875178192686720:12345-192.168.202.55@tcp:35:bash.0 00000100:00100000:2.0:1788309554.984699:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc91ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+53:10531:x1875178192686720:12345-192.168.202.55@tcp:35:bash.0 Request processed in 1418us (2019us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1788309554.984711:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 29 00000100:00100000:3.0:1788309555.044444:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309555.044683:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192686848 00000100:00100000:1.0:1788309555.044697:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192686848 00000100:00100000:1.0:1788309555.044863:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 107 00000100:00100000:1.0:1788309555.044873:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc91f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+53:10537:x1875178192686848:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:1.0:1788309555.044904:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788309555.044927:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549000/0x63a04852f4628e03 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ab43 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.045003:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548c00/0x63a04852f4628e0a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.045020:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548c00/0x63a04852f4628e0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.045033:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548c00/0x63a04852f4628e0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788309555.045115:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:1.0:1788309555.045136:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1788309555.045170:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548c00/0x63a04852f4628e0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.045204:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549000/0x63a04852f4628e03 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab43 expref: 55 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.045228:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548c00/0x63a04852f4628e0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab43 expref: 54 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.045237:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97c8d832f400) 00010000:00010000:1.0:1788309555.045241:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788309555.045244:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8f5548c00, rc 0) 00000100:00100000:1.0:1788309555.045785:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc91f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+54:10537:x1875178192686848:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 910us (1354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309555.045795:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 107 00000100:00100000:3.0:1788309555.048548:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309555.048599:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192686976 00000100:00100000:1.0:1788309555.048614:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192686976 00000100:00100000:1.0:1788309555.048689:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 108 00000100:00100000:1.0:1788309555.048703:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc91d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+54:10537:x1875178192686976:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:1.0:1788309555.048730:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788309555.048819:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628e11 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ab4a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.048894:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548400/0x63a04852f4628e18 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.048909:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548400/0x63a04852f4628e18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.048940:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548400/0x63a04852f4628e18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.048953:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549200/0x63a04852f4628e1f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.048958:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549200/0x63a04852f4628e1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.048963:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549200/0x63a04852f4628e1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.049092:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548a00/0x63a04852f4628e26 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.049099:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548a00/0x63a04852f4628e26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.049104:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548a00/0x63a04852f4628e26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788309555.049144:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788309555.049149:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788309555.049166:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548a00/0x63a04852f4628e26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.049175:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548a00/0x63a04852f4628e26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.049183:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548400/0x63a04852f4628e18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.049195:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548400/0x63a04852f4628e18 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.049200:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548400/0x63a04852f4628e18 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.049204:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8f5548400 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:1.0:1788309555.049207:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548400/0x63a04852f4628e18 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.049212:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548400/0x63a04852f4628e18 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.049227:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97c8d832f400) 00010000:00010000:1.0:1788309555.049230:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788309555.049235:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548400/0x63a04852f4628e18 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.049241:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548400/0x63a04852f4628e18 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.049258:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549200/0x63a04852f4628e1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.049265:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549200/0x63a04852f4628e1f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.049271:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549200/0x63a04852f4628e1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.049306:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8f5549200 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:1.0:1788309555.049375:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549200/0x63a04852f4628e1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.049394:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549200/0x63a04852f4628e1f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.049403:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97c8d832ff00) 00010000:00010000:1.0:1788309555.049405:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788309555.049407:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549200/0x63a04852f4628e1f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.049411:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549200/0x63a04852f4628e1f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.049444:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628e11 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab4a expref: 56 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.049453:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548a00/0x63a04852f4628e26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab4a expref: 55 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.049458:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97c8d83f4100) 00010000:00010000:1.0:1788309555.049459:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788309555.049462:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8f5548a00, rc 0) 00000100:00100000:1.0:1788309555.049573:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc91d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+55:10537:x1875178192686976:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 873us (1039us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309555.049581:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 108 00000100:00100000:2.0:1788309555.053110:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309555.053214:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192687104 00000100:00100000:1.0:1788309555.053228:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192687104 00000100:00100000:1.0:1788309555.053373:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 7 00000100:00100000:1.0:1788309555.053396:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc768e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+55:2351:x1875178192687104:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788309555.053434:0:8447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788309555.053466:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548a00/0x63a04852f4628e26 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab4a expref: 55 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.053742:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97c8d83f4100) 00010000:00010000:1.0:1788309555.053749:0:8447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788309555.053825:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc768e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+54:2351:x1875178192687104:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 431us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309555.053834:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 7 00000100:00100000:3.0:1788309555.055798:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309555.055932:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192687360 00000100:00100000:1.0:1788309555.055945:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192687360 00000100:00100000:1.0:1788309555.056022:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 109 00000100:00100000:1.0:1788309555.056035:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc91c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+54:10537:x1875178192687360:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:1.0:1788309555.056063:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788309555.056090:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549000/0x63a04852f4628e2d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ab51 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.056229:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f4628e34 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.056246:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548600/0x63a04852f4628dfc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab3c expref: 55 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.056256:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f4628e34 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.056360:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548600/0x63a04852f4628dfc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab3c expref: 55 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.056410:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548600/0x63a04852f4628dfc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab3c expref: 55 pid: 5837 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309555.056428:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8f524ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875178210527488:192.168.202.55@tcp:104: 00000100:00100000:1.0:1788309555.056554:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8e06866c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788309555.062112:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8f524ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875178210527488:192.168.202.55@tcp:104: 00010000:00010000:1.0:1788309555.062148:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f4628e34 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309555.063017:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309555.063222:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192687488 00000100:00100000:0.0:1788309555.063232:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192687488 00010000:00010000:0.0:1788309555.063430:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548600/0x63a04852f4628dfc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab3c expref: 56 pid: 5837 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309555.063512:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 52 00000100:00100000:0.0:1788309555.063525:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc91fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+56:2350:x1875178192687488:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788309555.063565:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788309555.063572:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548600/0x63a04852f4628dfc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab3c expref: 56 pid: 5837 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309555.063584:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548600/0x63a04852f4628dfc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab3c expref: 56 pid: 5837 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309555.063606:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548600/0x63a04852f4628dfc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab3c expref: 56 pid: 5837 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309555.063624:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97c8d83f4100) 00010000:00010000:0.0:1788309555.063628:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f4628e34 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309555.063636:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f4628e34 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309555.063642:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f4628e34 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309555.063664:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788309555.063743:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc91fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+55:2350:x1875178192687488:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 221us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309555.063750:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 52 00010000:00010000:1.0:1788309555.064041:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f4628e34 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.064048:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f4628e34 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788309555.064070:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788309555.064243:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549000/0x63a04852f4628e2d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab51 expref: 56 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.064262:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f4628e34 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab51 expref: 55 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.064271:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97c8d83f4100) 00010000:00010000:1.0:1788309555.064274:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788309555.064298:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8f5548800, rc 0) 00000100:00100000:1.0:1788309555.064350:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc91c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+55:10537:x1875178192687360:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 8318us (8567us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1788309555.064370:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 109 00000100:00100000:0.0:1788309555.066919:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309555.067082:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192687744 00000100:00100000:1.0:1788309555.067095:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192687744 00000100:00100000:1.0:1788309555.067161:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 8 00000100:00100000:1.0:1788309555.067174:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6587100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+55:10537:x1875178192687744:12345-192.168.202.55@tcp:103:lfs.0 00010000:00010000:1.0:1788309555.067195:0:8447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788309555.067550:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9600/0x63a04852f4628d93 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab27 expref: 55 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.067572:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97c8d83f4100) 00010000:00010000:1.0:1788309555.067576:0:8447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788309555.067639:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6587100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+54:10537:x1875178192687744:12345-192.168.202.55@tcp:103:lfs.0 Request processed in 466us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309555.067647:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 8 00000100:00100000:1.0:1788309555.069834:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309555.069978:0:8305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192687872 00000100:00100000:2.0:1788309555.069991:0:8305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192687872 00000100:00100000:2.0:1788309555.070059:0:8305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 110 00000100:00100000:2.0:1788309555.070089:0:8305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f524ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+54:10537:x1875178192687872:12345-192.168.202.55@tcp:58:lfs.0 00010000:00010000:2.0:1788309555.070220:0:8305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4628e42 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.070242:0:8305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4628e42 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.070256:0:8305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4628e42 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788309555.070953:0:8305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1788309555.071123:0:8305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f524ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+54:10537:x1875178192687872:12345-192.168.202.55@tcp:58:lfs.0 Request processed in 1033us (1299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309555.071134:0:8305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 110 00000100:00100000:2.0:1788309555.074485:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309555.074690:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192688000 00000100:00100000:1.0:1788309555.074705:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192688000 00000100:00100000:1.0:1788309555.074800:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 111 00000100:00100000:1.0:1788309555.074814:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc76ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+54:10537:x1875178192688000:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:1.0:1788309555.074844:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788309555.074873:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548a00/0x63a04852f4628e49 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ab58 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.074957:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4628e42 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.074971:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548a00/0x63a04852f4628e49 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab58 expref: 55 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.075014:0:5838:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4628e42 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.075031:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548a00/0x63a04852f4628e49 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab58 expref: 55 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.075048:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97c8d83f4100) 00010000:00010000:1.0:1788309555.075051:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788309555.075056:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548a00/0x63a04852f4628e49 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab58 expref: 55 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.075064:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8f5548a00, rc 0) 00000100:00100000:1.0:1788309555.075186:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc76ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+55:10537:x1875178192688000:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 375us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309555.075194:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 111 00000040:00080000:3.0:1788309555.296644:0:11678:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788309555.296657:0:11678:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788309555.296819:0:11678:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1788309555.296829:0:11678:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788309555.298061:0:11678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc91c000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11678:1875178210527616:192.168.202.55@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788309555.298297:0:11678:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8e6bc1f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788309555.304340:0:11678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc91c000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11678:1875178210527616:192.168.202.55@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788309555.318675:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309555.318799:0:8305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192688128 00000100:00100000:2.0:1788309555.318813:0:8305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192688128 00000100:00100000:2.0:1788309555.318893:0:8305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 112 00000100:00100000:2.0:1788309555.318907:0:8305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6584380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+55:10538:x1875178192688128:12345-192.168.202.55@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788309555.318952:0:8305:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788309555.319090:0:8305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6584380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+55:10538:x1875178192688128:12345-192.168.202.55@tcp:53:lhsmtool_posix.0 Request processed in 187us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309555.319100:0:8305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 112 00000100:00100000:2.0:1788309555.324624:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309555.324756:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192688256 00000100:00100000:1.0:1788309555.324770:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192688256 00000100:00100000:1.0:1788309555.324846:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 113 00000100:00100000:1.0:1788309555.324861:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc768700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+55:10538:x1875178192688256:12345-192.168.202.55@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788309555.324969:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549000/0x63a04852f4628e50 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.324991:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549000/0x63a04852f4628e50 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.325008:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549000/0x63a04852f4628e50 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.325051:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628e57 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.325059:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628e57 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.325067:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628e57 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.325096:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549200/0x63a04852f4628e5e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.325106:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549200/0x63a04852f4628e5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.325114:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549200/0x63a04852f4628e5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788309555.325165:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788309555.325170:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788309555.325187:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549200/0x63a04852f4628e5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.325392:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549000/0x63a04852f4628e50 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.325400:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549000/0x63a04852f4628e50 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.325408:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549000/0x63a04852f4628e50 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.325426:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8f5549000 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:1.0:1788309555.325432:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549000/0x63a04852f4628e50 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.325441:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549000/0x63a04852f4628e50 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.325457:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97c8c2ab9600) 00010000:00010000:1.0:1788309555.325461:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788309555.325467:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549000/0x63a04852f4628e50 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.325473:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549000/0x63a04852f4628e50 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.325493:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628e57 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.325500:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628e57 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.325507:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628e57 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.325512:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8f5548000 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:1.0:1788309555.325515:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628e57 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.325522:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628e57 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.325545:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff97c8d832ff00) 00010000:00010000:1.0:1788309555.325548:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788309555.325551:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628e57 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.325557:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628e57 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.325575:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549200/0x63a04852f4628e5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.325582:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549200/0x63a04852f4628e5e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.325588:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549200/0x63a04852f4628e5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.325594:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8f5549200 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:1.0:1788309555.325597:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549200/0x63a04852f4628e5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.325603:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549200/0x63a04852f4628e5e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.325610:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97c8d83f4100) 00010000:00010000:1.0:1788309555.325613:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788309555.325616:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549200/0x63a04852f4628e5e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.325622:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549200/0x63a04852f4628e5e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309555.325744:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc768700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+55:10538:x1875178192688256:12345-192.168.202.55@tcp:34:lhsmtool_posix.0 Request processed in 885us (1133us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309555.325753:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 113 00000100:00100000:0.0:1788309555.347652:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309555.349726:0:8305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192688512 00000100:00100000:2.0:1788309555.349757:0:8305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192688512 00000100:00100000:2.0:1788309555.349862:0:8305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 114 00000100:00100000:2.0:1788309555.349875:0:8305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6586a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+55:10538:x1875178192688512:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788309555.349925:0:8305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309555.349955:0:8305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628e65 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ab5f expref: -99 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.350830:0:8305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4628e6c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.350847:0:8305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4628e6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.350861:0:8305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4628e6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788309555.350875:0:8305:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788309555.351440:0:8305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4628e6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.351450:0:8305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4628e6c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.351458:0:8305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4628e6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.351465:0:8305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d8600 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309555.351471:0:8305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4628e6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.351480:0:8305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4628e6c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.351883:0:8305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97c8d83f4100) 00010000:00010000:2.0:1788309555.351905:0:8305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788309555.351911:0:8305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4628e6c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.351919:0:8305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4628e6c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.352064:0:8305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628e65 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab5f expref: 57 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.352077:0:8305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97c8c2ab9600) 00010000:00010000:2.0:1788309555.352080:0:8305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788309555.352085:0:8305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628e65 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab5f expref: 57 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.352098:0:8305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8e26d8e00, rc 0) 00000100:00100000:2.0:1788309555.352611:0:8305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6586a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+56:10538:x1875178192688512:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 2338us (4575us total) trans 4294967397 rc 301/301 00000100:00100000:2.0:1788309555.352627:0:8305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 114 00000100:00100000:1.0:1788309555.357511:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309555.357745:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192688640 00000100:00100000:3.0:1788309555.357759:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192688640 00000100:00100000:3.0:1788309555.357875:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 115 00000100:00100000:3.0:1788309555.357889:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f524f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+56:10538:x1875178192688640:12345-192.168.202.55@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788309555.357943:0:5838:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788309555.358114:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f524f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+56:10538:x1875178192688640:12345-192.168.202.55@tcp:53:lhsmtool_posix.0 Request processed in 227us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309555.358123:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 115 00000100:00100000:3.0:1788309555.363806:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309555.364130:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192688896 00000100:00100000:1.0:1788309555.364143:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192688896 00000100:00100000:1.0:1788309555.364268:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 116 00000100:00100000:1.0:1788309555.364305:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc91c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+56:10538:x1875178192688896:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788309555.364332:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788309555.364337:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788309555.364372:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548c00/0x63a04852f4628e0a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab43 expref: 56 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.364430:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97c8d832f400) 00010000:00010000:1.0:1788309555.364436:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788309555.364453:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628e7a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ab66 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788309555.366349:0:5837:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:1.0:1788309555.366706:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549000/0x63a04852f4628e81 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.366727:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549000/0x63a04852f4628e81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.367536:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549000/0x63a04852f4628e81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.367663:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628e7a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab66 expref: 58 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.367691:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549000/0x63a04852f4628e81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab66 expref: 57 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.367702:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97c8d832ff00) 00010000:00010000:1.0:1788309555.367705:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788309555.367709:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8f5549000, rc 0) 00000100:00100000:1.0:1788309555.367942:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc91c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+57:10538:x1875178192688896:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 3661us (4148us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1788309555.367954:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 116 00000100:00100000:3.0:1788309555.371913:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309555.371968:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192689152 00000100:00100000:2.0:1788309555.371980:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192689152 00000100:00100000:2.0:1788309555.372036:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 117 00000100:00100000:2.0:1788309555.372049:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc91e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+57:10538:x1875178192689152:12345-192.168.202.55@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788309555.372127:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788309555.372160:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549000/0x63a04852f4628e81 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab66 expref: 57 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.372184:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97c8d832ff00) 00010000:00010000:2.0:1788309555.372215:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788309555.372255:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628e8f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.372271:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628e8f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.372305:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628e8f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.372322:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4628e96 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x67a3ce04 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.372329:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4628e96 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x67a3ce04 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.372336:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4628e96 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x67a3ce04 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.372589:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628e8f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.372596:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628e8f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.372601:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628e8f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.372605:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d8e00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309555.372609:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628e8f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.372616:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628e8f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.372630:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97c8d832f400) 00010000:00010000:2.0:1788309555.372632:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788309555.372635:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628e8f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.372640:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628e8f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.372647:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4628e96 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x67a3ce04 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.372651:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4628e96 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x67a3ce04 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.372654:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4628e96 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x67a3ce04 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.372658:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d8600 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309555.372660:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4628e96 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x67a3ce04 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.372663:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4628e96 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x67a3ce04 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.372666:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x67a3ce04 (ffff97c8d83f4700) 00010000:00010000:2.0:1788309555.372667:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788309555.372669:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4628e96 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x67a3ce04 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.372672:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4628e96 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x67a3ce04 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309555.372772:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc91e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+56:10538:x1875178192689152:12345-192.168.202.55@tcp:36:lhsmtool_posix.0 Request processed in 724us (870us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788309555.372780:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 117 00000100:00100000:2.0:1788309555.375352:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309555.375439:0:8305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192689280 00000100:00100000:0.0:1788309555.375453:0:8305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192689280 00000100:00100000:0.0:1788309555.375547:0:8305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 118 00000100:00100000:0.0:1788309555.375558:0:8305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc76a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+56:10538:x1875178192689280:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788309555.375583:0:8305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788309555.375611:0:8305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f800/0x63a04852f4628e9d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ab6d expref: -99 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309555.375652:0:8305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e800/0x63a04852f4628ea4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309555.375667:0:8305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e800/0x63a04852f4628ea4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309555.375679:0:8305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e800/0x63a04852f4628ea4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309555.375805:0:8305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f800/0x63a04852f4628e9d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab6d expref: 58 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309555.375830:0:8305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e800/0x63a04852f4628ea4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab6d expref: 57 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309555.375839:0:8305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97c8c2ab9300) 00010000:00010000:0.0:1788309555.375842:0:8305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788309555.375846:0:8305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8ecf2e800, rc 0) 00000100:00100000:0.0:1788309555.376147:0:8305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc76a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+57:10538:x1875178192689280:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 589us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309555.376154:0:8305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 118 00000100:00100000:2.0:1788309555.382609:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309555.382727:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192689536 00000100:00100000:1.0:1788309555.382741:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192689536 00000100:00100000:1.0:1788309555.382858:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 119 00000100:00100000:1.0:1788309555.382874:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc76b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+57:10538:x1875178192689536:12345-192.168.202.55@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788309555.382992:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628eab lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.383014:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628eab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.383028:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628eab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788309555.383433:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00010000:1.0:1788309555.383552:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f2e505dc reply state 00000000ab5cab9d transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628eab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309555.383581:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788309555.383717:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc76b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+59:10538:x1875178192689536:12345-192.168.202.55@tcp:36:lhsmtool_posix.0 Request processed in 846us (1121us total) trans 4294967399 rc 0/0 00000100:00100000:1.0:1788309555.383726:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 119 00000100:00100000:1.0:1788309555.386324:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309555.386654:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192689664 00000100:00100000:3.0:1788309555.386669:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192689664 00010000:00010000:2.0:1788309555.386708:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628eab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.386723:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628eab lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.386732:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628eab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.386740:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8f5548000 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309555.386746:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628eab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.386756:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628eab lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.386779:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97c8c2ab9300) 00010000:00010000:2.0:1788309555.386783:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788309555.386789:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628eab lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309555.386796:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 120 00010000:00010000:2.0:1788309555.386800:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628eab lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309555.386814:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f524d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+59:10538:x1875178192689664:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788309555.386846:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309555.386869:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628eb2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ab74 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309555.386943:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628eb2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab74 expref: 59 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309555.386957:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628eb2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab74 expref: 59 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309555.387119:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97c8c2ab9300) 00010000:00010000:3.0:1788309555.387122:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788309555.387125:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8c153a200, rc 0) 00000100:00100000:3.0:1788309555.387201:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f524d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+59:10538:x1875178192689664:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 393us (924us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309555.388692:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 120 00000100:00100000:3.0:1788309555.391073:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309555.391142:0:10673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192689792 00000100:00100000:2.0:1788309555.391174:0:10673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192689792 00000100:00100000:2.0:1788309555.391479:0:10673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 37 00000100:00100000:2.0:1788309555.391493:0:10673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc91dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+8:2351:x1875178192689792:12345-192.168.202.55@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788309555.391903:0:10673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc91dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+9:2351:x1875178192689792:12345-192.168.202.55@tcp:2:lhsmtool_posix.0 Request processed in 411us (842us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788309555.391912:0:10673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 37 00000100:00100000:2.0:1788309555.395983:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309555.396069:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192690048 00000100:00100000:0.0:1788309555.396083:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192690048 00000100:00100000:0.0:1788309555.396203:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 30 00000100:00100000:0.0:1788309555.396216:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8efefbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+59:10538:x1875178192690048:12345-192.168.202.55@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788309555.396624:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8efefbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+60:10538:x1875178192690048:12345-192.168.202.55@tcp:35:lhsmtool_posix.0 Request processed in 409us (654us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1788309555.396634:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 30 00000100:00100000:3.0:1788309555.400421:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309555.400823:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192690304 00000100:00100000:2.0:1788309555.400838:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192690304 00000100:00100000:2.0:1788309555.400972:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 121 00000100:00100000:2.0:1788309555.400986:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecf14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+60:10538:x1875178192690304:12345-192.168.202.55@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788309555.401140:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecf14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+60:10538:x1875178192690304:12345-192.168.202.55@tcp:57:lhsmtool_posix.0 Request processed in 157us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309555.401149:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 121 00000100:00100000:1.0:1788309555.407927:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309555.408166:0:8305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192690432 00000100:00100000:0.0:1788309555.408179:0:8305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192690432 00000100:00100000:0.0:1788309555.408488:0:8305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 122 00000100:00100000:0.0:1788309555.408502:0:8305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f524c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+60:10538:x1875178192690432:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788309555.408534:0:8305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788309555.408564:0:8305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f800/0x63a04852f4628eb9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ab7b expref: -99 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309555.408703:0:8305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e200/0x63a04852f4628ec0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309555.408722:0:8305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e200/0x63a04852f4628ec0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309555.408744:0:8305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e200/0x63a04852f4628ec0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788309555.408796:0:8305:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788309555.408819:0:8305:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e200/0x63a04852f4628ec0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309555.408852:0:8305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f800/0x63a04852f4628eb9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab7b expref: 62 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309555.408892:0:8305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e200/0x63a04852f4628ec0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab7b expref: 61 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309555.408903:0:8305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97c8c2ab9300) 00010000:00010000:0.0:1788309555.408906:0:8305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788309555.408911:0:8305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8ecf2e200, rc 0) 00000100:00100000:0.0:1788309555.408997:0:8305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f524c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+61:10538:x1875178192690432:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 498us (1086us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309555.409005:0:8305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 122 00000100:00100000:3.0:1788309555.415453:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309555.415830:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192690560 00000100:00100000:2.0:1788309555.415846:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192690560 00000100:00100000:2.0:1788309555.415967:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 38 00000100:00100000:2.0:1788309555.415980:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecdc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+9:2350:x1875178192690560:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788309555.416012:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309555.416046:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bfa15baf/0x63a04852f4628ec7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ab82 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788309555.416082:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a977033, blocks: 0x1 00010000:00010000:2.0:1788309555.416109:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=318s v=(0 0) 00010000:00010000:2.0:1788309555.416115:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788309555.416126:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bfa15baf/0x63a04852f4628ec7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab82 expref: 10 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.416170:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bfa15baf/0x63a04852f4628ec7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab82 expref: 10 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.416185:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8e26d8e00, rc 0) 00000100:00100000:2.0:1788309555.416265:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecdc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+10:2350:x1875178192690560:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 287us (826us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309555.416273:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 38 00000100:00100000:0.0:1788309555.420029:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309555.420117:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192690816 00000100:00100000:1.0:1788309555.420130:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192690816 00000100:00100000:1.0:1788309555.420208:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 123 00000100:00100000:1.0:1788309555.420222:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6587800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+61:10538:x1875178192690816:12345-192.168.202.55@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788309555.420411:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6587800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+61:10538:x1875178192690816:12345-192.168.202.55@tcp:57:lhsmtool_posix.0 Request processed in 192us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309555.420420:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 123 00000100:00100000:3.0:1788309555.426552:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309555.426798:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192690944 00000100:00100000:1.0:1788309555.426813:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192690944 00000100:00100000:1.0:1788309555.426930:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 39 00000100:00100000:1.0:1788309555.426941:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecdc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+10:10538:x1875178192690944:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788309555.426970:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788309555.426997:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e00f599/0x63a04852f4628ece lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ab89 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.427030:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bfa15baf/0x63a04852f4628ec7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab82 expref: 11 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.427038:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788309555.427058:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788309555.427062:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e00f599/0x63a04852f4628ece lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab89 expref: 11 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.427123:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bfa15baf/0x63a04852f4628ec7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab82 expref: 11 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.427139:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bfa15baf/0x63a04852f4628ec7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab82 expref: 11 pid: 6680 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309555.427156:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8f524fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1875178210527744:192.168.202.55@tcp:104: 00000100:00100000:1.0:1788309555.427385:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8e06866c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788309555.433047:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8f524fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1875178210527744:192.168.202.55@tcp:104: 00010000:00010000:1.0:1788309555.433103:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001e00f599/0x63a04852f4628ece lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab89 expref: 11 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.433132:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8f5548400, rc 0) 00000100:00100000:1.0:1788309555.433224:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecdc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+11:10538:x1875178192690944:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 6275us (6679us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309555.433234:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 39 00000100:00100000:0.0:1788309555.435838:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309555.436024:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192691072 00000100:00100000:2.0:1788309555.436039:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192691072 00010000:00010000:2.0:1788309555.436099:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bfa15baf/0x63a04852f4628ec7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab82 expref: 11 pid: 6680 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309555.436146:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 53 00000100:00100000:2.0:1788309555.436157:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6b2b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+11:2351:x1875178192691072:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788309555.436180:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788309555.436208:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bfa15baf/0x63a04852f4628ec7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab82 expref: 11 pid: 6680 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.436374:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bfa15baf/0x63a04852f4628ec7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab82 expref: 11 pid: 6680 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.436412:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bfa15baf/0x63a04852f4628ec7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab82 expref: 11 pid: 6680 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.436460:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788309555.436465:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788309555.436484:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001e00f599/0x63a04852f4628ece lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab89 expref: 10 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.436497:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e00f599/0x63a04852f4628ece lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab89 expref: 10 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.436546:0:5822:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001e00f599/0x63a04852f4628ece lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab89 expref: 10 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309555.436563:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8efef8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5822:1875178210527872:192.168.202.55@tcp:105: 00000100:00100000:2.0:1788309555.436670:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c3522c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788309555.440589:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309555.440661:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8efef8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5822:1875178210527872:192.168.202.55@tcp:105: 00010000:00010000:2.0:1788309555.440702:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788309555.440765:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6b2b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+10:2351:x1875178192691072:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 4609us (4938us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309555.440780:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 53 00000100:00100000:1.0:1788309555.441061:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192691200 00000100:00100000:1.0:1788309555.441073:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192691200 00002000:00100000:1.0:1788309555.441134:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff97c8ecdc3480 x1875178192691200/t0(0) o4->86451057-f8bb-4d7c-a7c2-5c834b43e3d3@192.168.202.55@tcp:711/0 lens 504/0 e 0 to 0 dl 1788309566 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788309555.441145:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97c8ecdc3480 with x1875178192691200 ext(0->12) 00002000:00010000:1.0:1788309555.441152:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97c8ecdc3480 00000100:00100000:1.0:1788309555.441202:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 2 00000100:00100000:1.0:1788309555.441214:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecdc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+10:2350:x1875178192691200:12345-192.168.202.55@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788309555.443002:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecdc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+12:2350:x1875178192691200:12345-192.168.202.55@tcp:4:lhsmtool_posix.0 Request processed in 1784us (2423us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788309555.443013:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 2 00002000:00100000:1.0:1788309555.443027:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff97c8ecdc3480 x1875178192691200/t4294967308(0) o4->86451057-f8bb-4d7c-a7c2-5c834b43e3d3@192.168.202.55@tcp:711/0 lens 504/448 e 0 to 0 dl 1788309566 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788309555.443038:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97c8ecdc3480 with x1875178192691200 ext(0->12) 00002000:00010000:1.0:1788309555.443043:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97c8ecdc3480 00000100:00100000:3.0:1788309555.449202:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309555.449981:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192691328 00000100:00100000:0.0:1788309555.449997:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192691328 00000100:00100000:0.0:1788309555.450151:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 124 00000100:00100000:0.0:1788309555.450165:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6814700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+61:10538:x1875178192691328:12345-192.168.202.55@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788309555.480724:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:3.0:1788309555.480760:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:3.0:1788309555.480786:0:5859:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff97c8d120b240 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1788309555.480791:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97c8eff22900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff97c8d120b480 00000020:00080000:3.0:1788309555.480795:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97c8e2682500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff97c8fcaed000 00000020:00080000:1.0:1788309555.481083:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1788309555.481207:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8f524fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210528000:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788309555.481852:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309555.482033:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210528000 00000100:00100000:1.0:1788309555.482042:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210528000 00000100:00100000:1.0:1788309555.482135:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788309555.482150:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6814e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1875178210528000:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788309555.482189:0:6681:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:1.0:1788309555.482242:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a977032, atime: 0x6a977032, ctime: 0x6a977032, blocks: 0x1 00010000:00010000:1.0:1788309555.482252:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eae37608/0x63a04852f4628ed5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.482294:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=318s v=(0 0) 00010000:00010000:1.0:1788309555.482300:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788309555.482309:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eae37608/0x63a04852f4628ed5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.482332:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eae37608/0x63a04852f4628ed5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.482367:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eae37608/0x63a04852f4628ed5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.482386:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eae37608/0x63a04852f4628ed5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.482409:0:6681:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788309555.483237:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6814e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3303:x1875178210528000:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1088us (1383us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788309555.483248:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:1.0:1788309555.483314:0:7627:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788309555.483322:0:7627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eae37608/0x63a04852f4628ed5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.483333:0:7627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8f5548e00 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:1.0:1788309555.483339:0:7627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eae37608/0x63a04852f4628ed5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.483351:0:7627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eae37608/0x63a04852f4628ed5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.483386:0:7627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eae37608/0x63a04852f4628ed5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.483394:0:7627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eae37608/0x63a04852f4628ed5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.483426:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309555.483428:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309555.483430:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788309555.483477:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97c8f524fb80/2, rc 0, transno 4294967304 00000100:00100000:1.0:1788309555.483484:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8f524fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210528000:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788309555.483907:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:1.0:1788309555.483943:0:5859:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff97c8c3522d80 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1788309555.483947:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97c8ecb57f00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff97c8c3522b40 00000020:00080000:1.0:1788309555.483951:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97c8ecb57100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff97c8ffb0d400 00000100:00080000:3.0:1788309555.484141:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00080000:1.0:1788309555.484178:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000100:00100000:2.0:1788309555.484568:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8efef8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210528128:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788309555.484637:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309555.484694:0:10673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210528128 00000100:00100000:2.0:1788309555.484703:0:10673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210528128 00000100:00100000:2.0:1788309555.484765:0:10673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788309555.484776:0:10673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc768e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3300:x1875178210528128:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788309555.484822:0:10673:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:2.0:1788309555.484856:0:10673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfa15baf/0x63a04852f4628edc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.484883:0:10673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ca4db15a/0x63a04852f4628c97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aae8 expref: 11 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.484893:0:10673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1788309555.484898:0:10673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788309555.484903:0:10673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bfa15baf/0x63a04852f4628edc lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.484940:0:10673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ca4db15a/0x63a04852f4628c97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aae8 expref: 11 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.484957:0:10673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ca4db15a/0x63a04852f4628c97 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aae8 expref: 11 pid: 6681 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309555.484971:0:10673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc91fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10673:1875178210528256:192.168.202.55@tcp:104: 00000100:00100000:2.0:1788309555.485061:0:10673:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c35220c0 going to sleep for 11 seconds 00000020:00080000:1.0:1788309555.485393:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1788309555.488598:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6814700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+15:10538:x1875178192691328:12345-192.168.202.55@tcp:44:lhsmtool_posix.0 Request processed in 38420us (39394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309555.488616:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 124 00000100:00100000:0.0:1788309555.492046:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309555.492194:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309555.492533:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192691584 00000100:00100000:1.0:1788309555.492547:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192691584 00000100:00100000:1.0:1788309555.492618:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 42 00000100:00100000:1.0:1788309555.492629:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6584700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+12:2350:x1875178192691584:12345-192.168.202.55@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788309555.493695:0:10673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc91fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10673:1875178210528256:192.168.202.55@tcp:104: 00010000:00010000:2.0:1788309555.493738:0:10673:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bfa15baf/0x63a04852f4628edc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309555.493994:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192691456 00000100:00100000:3.0:1788309555.494002:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192691456 00010000:00010000:3.0:1788309555.494046:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ca4db15a/0x63a04852f4628c97 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aae8 expref: 13 pid: 6681 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309555.494131:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 54 00000100:00100000:3.0:1788309555.494142:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6585500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+13:2350:x1875178192691456:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788309555.494157:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788309555.494164:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ca4db15a/0x63a04852f4628c97 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aae8 expref: 13 pid: 6681 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309555.494180:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ca4db15a/0x63a04852f4628c97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aae8 expref: 13 pid: 6681 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309555.494207:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca4db15a/0x63a04852f4628c97 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aae8 expref: 13 pid: 6681 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309555.494241:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788309555.494265:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788309555.494273:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bfa15baf/0x63a04852f4628edc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309555.494300:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bfa15baf/0x63a04852f4628edc lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309555.494338:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788309555.494393:0:10673:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bfa15baf/0x63a04852f4628edc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309555.494403:0:10673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bfa15baf/0x63a04852f4628edc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309555.494426:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6585500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+12:2350:x1875178192691456:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 286us (2396us total) trans 0 rc 0/0 00010000:00010000:0.0:1788309555.494426:0:10673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfa15baf/0x63a04852f4628edc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309555.494435:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 54 00010000:00010000:0.0:1788309555.494435:0:10673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bfa15baf/0x63a04852f4628edc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309555.494454:0:10673:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788309555.495158:0:10673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc768e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3300:x1875178210528128:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10379us (10517us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788309555.495169:0:10673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00080000:2.0:1788309555.495200:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97c8efef8000/2, rc 0, transno 4294967309 00010000:00010000:0.0:1788309555.495396:0:7628:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788309555.495406:0:7628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bfa15baf/0x63a04852f4628edc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309555.495417:0:7628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d8e00 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:0.0:1788309555.495422:0:7628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfa15baf/0x63a04852f4628edc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309555.495432:0:7628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfa15baf/0x63a04852f4628edc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309555.495448:0:7628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bfa15baf/0x63a04852f4628edc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309555.495455:0:7628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bfa15baf/0x63a04852f4628edc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309555.495497:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309555.495500:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309555.495502:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788309555.495548:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8efef8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210528128:0@lo:6:osp-syn-1-0.0 00000001:00080000:2.0:1788309555.540207:0:7639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:2.0:1788309555.540247:0:7639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:1.0:1788309555.540616:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6584700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:2350:x1875178192691584:12345-192.168.202.55@tcp:16:lhsmtool_posix.0 Request processed in 47980us (48413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309555.540632:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 42 00000100:00100000:0.0:1788309555.544661:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309555.544896:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192691840 00000100:00100000:1.0:1788309555.544910:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192691840 00000100:00100000:1.0:1788309555.545107:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 125 00000100:00100000:1.0:1788309555.545121:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6587b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+15:10538:x1875178192691840:12345-192.168.202.55@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788309555.545208:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788309555.545246:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e200/0x63a04852f4628ec0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab7b expref: 15 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.545335:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97c8c2ab9300) 00010000:00010000:1.0:1788309555.545341:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788309555.545395:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628ee3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.545413:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628ee3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.545423:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628ee3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788309555.546034:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bb56a039 reply state 000000000af54ce6 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628ee3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309555.546050:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788309555.546180:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6587b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+16:10538:x1875178192691840:12345-192.168.202.55@tcp:36:lhsmtool_posix.0 Request processed in 1061us (1532us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1788309555.546189:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 125 00010000:00010000:3.0:1788309555.548145:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628ee3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309555.548164:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628ee3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309555.548173:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628ee3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309555.548179:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8f5548e00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:3.0:1788309555.548185:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628ee3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309555.548202:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628ee3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309555.548224:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97c8c2ab9300) 00010000:00010000:3.0:1788309555.548228:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788309555.548233:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628ee3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309555.548256:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628ee3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309555.553227:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309555.553877:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192691968 00000100:00100000:2.0:1788309555.553892:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192691968 00000100:00100000:2.0:1788309555.553962:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 43 00000100:00100000:2.0:1788309555.553976:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6584000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:2351:x1875178192691968:12345-192.168.202.55@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788309555.554540:0:6682:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788309555.554546:0:6682:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788309554 00002000:00010000:2.0:1788309555.554549:0:6682:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788309554 00002000:00010000:2.0:1788309555.554551:0:6682:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1788309555 -> 1788309554 00002000:00010000:2.0:1788309555.554553:0:6682:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788309555.554697:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6584000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+7:2351:x1875178192691968:12345-192.168.202.55@tcp:2:lhsmtool_posix.0 Request processed in 722us (1482us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788309555.554706:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 43 00000100:00100000:1.0:1788309555.558852:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309555.558995:0:8305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192692224 00000100:00100000:2.0:1788309555.559010:0:8305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192692224 00000100:00100000:2.0:1788309555.561142:0:8305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 126 00000100:00100000:2.0:1788309555.561179:0:8305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f524df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+15:10538:x1875178192692224:12345-192.168.202.55@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788309555.561431:0:8305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4628eea lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.561457:0:8305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e800/0x63a04852f4628ea4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab6d expref: 15 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.561466:0:8305:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4628eea lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.561621:0:8305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e800/0x63a04852f4628ea4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab6d expref: 15 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.561641:0:8305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e800/0x63a04852f4628ea4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab6d expref: 15 pid: 8305 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309555.561661:0:8305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc91fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8305:1875178210528384:192.168.202.55@tcp:104: 00000100:00100000:2.0:1788309555.562051:0:8305:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c3522300 going to sleep for 11 seconds 00000100:00100000:2.0:1788309555.564748:0:8305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc91fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8305:1875178210528384:192.168.202.55@tcp:104: 00010000:00010000:2.0:1788309555.564790:0:8305:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4628eea lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309555.565463:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309555.565569:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192692352 00000100:00100000:0.0:1788309555.565581:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192692352 00010000:00010000:0.0:1788309555.565632:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e800/0x63a04852f4628ea4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab6d expref: 16 pid: 8305 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309555.565691:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 55 00000100:00100000:0.0:1788309555.565703:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f524f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+16:2350:x1875178192692352:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788309555.565724:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788309555.565734:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e800/0x63a04852f4628ea4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab6d expref: 16 pid: 8305 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309555.565749:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e800/0x63a04852f4628ea4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab6d expref: 16 pid: 8305 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309555.565785:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e800/0x63a04852f4628ea4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab6d expref: 16 pid: 8305 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309555.565806:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97c8c2ab9300) 00010000:00010000:0.0:1788309555.565812:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4628eea lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309555.565847:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4628eea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309555.565856:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4628eea lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309555.565895:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788309555.565940:0:8305:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4628eea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309555.565948:0:8305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4628eea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309555.565985:0:8305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4628eea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309555.566002:0:8305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4628eea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309555.566010:0:8305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4628eea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309555.566017:0:8305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d8c00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:3.0:1788309555.566022:0:8305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4628eea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309555.566031:0:8305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4628eea lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309555.566042:0:8305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97c8c2ab9300) 00010000:00010000:3.0:1788309555.566045:0:8305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788309555.566049:0:8305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4628eea lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309555.566055:0:8305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4628eea lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309555.566067:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f524f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+15:2350:x1875178192692352:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 365us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309555.566075:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 55 00000100:00100000:3.0:1788309555.566111:0:8305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f524df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+14:10538:x1875178192692224:12345-192.168.202.55@tcp:55:lhsmtool_posix.0 Request processed in 4953us (7276us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788309555.566121:0:8305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 126 00000100:00100000:3.0:1788309555.570893:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309555.570968:0:10673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192692480 00000100:00100000:0.0:1788309555.570984:0:10673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192692480 00000100:00100000:0.0:1788309555.571074:0:10673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 44 00000100:00100000:0.0:1788309555.571088:0:10673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6817480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+7:2353:x1875178192692480:12345-192.168.202.55@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788309555.571153:0:10673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008da98bab/0x63a04852f4628ef1 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309555.571182:0:10673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001e00f599/0x63a04852f4628ece lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab89 expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309555.571194:0:10673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788309555.571200:0:10673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788309555.571206:0:10673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008da98bab/0x63a04852f4628ef1 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.571641:0:10673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001e00f599/0x63a04852f4628ece lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab89 expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.571661:0:10673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001e00f599/0x63a04852f4628ece lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab89 expref: 7 pid: 6682 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309555.571691:0:10673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc91fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10673:1875178210528512:192.168.202.55@tcp:104: 00000100:00100000:2.0:1788309555.571845:0:10673:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c3522300 going to sleep for 11 seconds 00000100:00100000:2.0:1788309555.575833:0:10673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc91fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10673:1875178210528512:192.168.202.55@tcp:104: 00010000:00010000:2.0:1788309555.575877:0:10673:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008da98bab/0x63a04852f4628ef1 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309555.576666:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309555.576950:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192692608 00000100:00100000:2.0:1788309555.576984:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192692608 00010000:00010000:2.0:1788309555.577034:0:8447:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001e00f599/0x63a04852f4628ece lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab89 expref: 8 pid: 6682 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309555.577083:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 56 00000100:00100000:2.0:1788309555.577097:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ec686680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+8:2350:x1875178192692608:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788309555.577118:0:8447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788309555.577150:0:8447:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001e00f599/0x63a04852f4628ece lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab89 expref: 8 pid: 6682 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.577167:0:8447:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001e00f599/0x63a04852f4628ece lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab89 expref: 8 pid: 6682 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.577204:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e00f599/0x63a04852f4628ece lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab89 expref: 8 pid: 6682 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.577240:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788309555.577245:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788309555.577253:0:8447:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008da98bab/0x63a04852f4628ef1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.577266:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008da98bab/0x63a04852f4628ef1 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.577362:0:8447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788309555.577446:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ec686680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+7:2350:x1875178192692608:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 350us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309555.577465:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 56 00010000:00010000:1.0:1788309555.577952:0:10673:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008da98bab/0x63a04852f4628ef1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.577966:0:10673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008da98bab/0x63a04852f4628ef1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.578003:0:10673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008da98bab/0x63a04852f4628ef1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.578027:0:10673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008da98bab/0x63a04852f4628ef1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.578036:0:10673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008da98bab/0x63a04852f4628ef1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.578043:0:10673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8ecf2f800 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:1.0:1788309555.578049:0:10673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008da98bab/0x63a04852f4628ef1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.578060:0:10673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008da98bab/0x63a04852f4628ef1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.578080:0:10673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008da98bab/0x63a04852f4628ef1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.578089:0:10673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008da98bab/0x63a04852f4628ef1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309555.578185:0:10673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6817480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:2353:x1875178192692480:12345-192.168.202.55@tcp:1:lhsmtool_posix.0 Request processed in 7098us (7304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309555.578194:0:10673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 44 00000100:00100000:3.0:1788309555.582238:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309555.582408:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192692864 00000100:00100000:2.0:1788309555.582423:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192692864 00000100:00100000:2.0:1788309555.582518:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 127 00000100:00100000:2.0:1788309555.582533:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c958e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+14:10538:x1875178192692864:12345-192.168.202.55@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788309555.582649:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628ef8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.582671:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628ef8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.582686:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628ef8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.583145:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628eff lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.583159:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628eb2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab74 expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.583169:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628eff lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.583213:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628eb2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab74 expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.583230:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628eb2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab74 expref: 15 pid: 5838 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309555.583272:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc91fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875178210528640:192.168.202.55@tcp:104: 00000100:00100000:2.0:1788309555.583664:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c3522300 going to sleep for 11 seconds 00000100:00100000:1.0:1788309555.587882:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309555.588421:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192692992 00000100:00100000:0.0:1788309555.588436:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192692992 00010000:00010000:0.0:1788309555.588657:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628eb2 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab74 expref: 16 pid: 5838 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309555.588716:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 57 00000100:00100000:0.0:1788309555.588741:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f524e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+16:2350:x1875178192692992:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788309555.588763:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788309555.588771:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628eb2 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab74 expref: 16 pid: 5838 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309555.588785:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628eb2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab74 expref: 16 pid: 5838 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309555.588814:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97c8c2ab9300) 00010000:00010000:0.0:1788309555.588822:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628eff lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309555.588833:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628eff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309555.588840:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628eff lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309555.588864:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788309555.588932:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f524e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+16:2350:x1875178192692992:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 204us (1065us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309555.588939:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 57 00010000:00010000:2.0:1788309555.590372:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628eb2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab74 expref: 15 pid: 5838 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309555.590413:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc91fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875178210528640:192.168.202.55@tcp:104: 00010000:00010000:2.0:1788309555.590448:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628eff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.590459:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628eff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.590466:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628eff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788309555.590931:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:2.0:1788309555.591115:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:2.0:1788309555.591169:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:2.0:1788309555.591680:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc91fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5839:1875178210528768:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788309555.591843:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309555.591888:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d120bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788309555.591990:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210528768 00000100:00100000:0.0:1788309555.592001:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210528768 00000100:00100000:0.0:1788309555.592078:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788309555.592112:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6979f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5839:x1875178210528768:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788309555.592230:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6979f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5839:x1875178210528768:12345-0@lo:1000:mdt00_002.0 Request processed in 122us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309555.592239:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788309555.592459:0:5839:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:2.0:1788309555.592467:0:5839:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:2.0:1788309555.592614:0:5839:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97c8efef8000, transno 4294967309 00000100:00100000:2.0:1788309555.592642:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc91fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5839:1875178210528768:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1788309555.594072:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:2.0:1788309555.594184:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e697a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5839:1875178210528896:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788309555.594811:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309555.594882:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d120b840 going to sleep for 11 seconds 00000100:00100000:0.0:1788309555.595067:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210528896 00000100:00100000:0.0:1788309555.595077:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210528896 00000100:00100000:0.0:1788309555.595172:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788309555.595184:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc91fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5839:x1875178210528896:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788309555.595703:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc91fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5839:x1875178210528896:12345-0@lo:1000:mdt00_002.0 Request processed in 516us (890us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1788309555.595712:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788309555.595853:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e697a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5839:1875178210528896:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1788309555.595906:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628eff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.595918:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628eff lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.595926:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628eff lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.595933:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d8e00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309555.595939:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628eff lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.595948:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628eff lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.595970:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97c8c2ab9300) 00010000:00010000:2.0:1788309555.595973:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788309555.595979:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628eff lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.595985:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628eff lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.596025:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4628e42 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.596033:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4628e42 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.596050:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4628e42 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.596055:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d8800 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309555.596058:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4628e42 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.596064:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4628e42 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.596073:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97c8d83f4100) 00010000:00010000:2.0:1788309555.596075:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788309555.596083:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548a00/0x63a04852f4628e49 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab58 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.596096:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548a00/0x63a04852f4628e49 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab58 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.596106:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548a00/0x63a04852f4628e49 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab58 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.596145:0:5839:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548a00/0x63a04852f4628e49 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab58 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309555.596161:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875178210529024:192.168.202.55@tcp:105: 00000100:00100000:2.0:1788309555.596267:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d120b840 going to sleep for 11 seconds 00000100:00100000:3.0:1788309555.600098:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875178210529024:192.168.202.55@tcp:105: 00010000:00010000:3.0:1788309555.600145:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4628e42 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309555.600157:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4628e42 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309555.600204:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628f06 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309555.600230:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628f06 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309555.600244:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628f06 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309555.600256:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628f06 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309555.600262:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628f06 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309555.600269:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628f06 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309555.600336:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8c153ac00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:3.0:1788309555.600341:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628f06 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309555.600349:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628f06 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309555.600364:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97c8d83f4100) 00010000:00010000:3.0:1788309555.600367:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788309555.600371:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628f06 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309555.600388:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628f06 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309555.600401:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628ef8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309555.600407:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628ef8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309555.600415:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628ef8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309555.600420:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d9c00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:3.0:1788309555.600423:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628ef8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309555.600429:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628ef8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309555.600449:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97c8d83f4100) 00010000:00010000:3.0:1788309555.600451:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788309555.600455:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628ef8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309555.600461:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628ef8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788309555.600990:0:11678:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788309555.600998:0:11678:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788309555.601528:0:11678:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1788309555.601541:0:11678:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788309555.601701:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c958e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+18:10538:x1875178192692864:12345-192.168.202.55@tcp:57:lhsmtool_posix.0 Request processed in 19165us (19482us total) trans 4294967406 rc 0/0 00000100:00100000:3.0:1788309555.601714:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 127 00000020:00080000:3.0:1788309555.601721:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1788309555.605611:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309555.605664:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309555.605746:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192693248 00000100:00100000:2.0:1788309555.605760:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192693248 00000100:00100000:2.0:1788309555.605841:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192693376 00000100:00100000:2.0:1788309555.605845:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192693376 00000100:00100000:2.0:1788309555.605864:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 31 00000100:00100000:2.0:1788309555.605876:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c958e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+19:10538:x1875178192693248:12345-192.168.202.55@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788309555.606789:0:5840:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788309555.606900:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:2.0:1788309555.606954:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628f0d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.606973:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628f0d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.606985:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628f0d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.606994:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628f0d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.607001:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628f0d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.607008:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628f0d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.607026:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788309555.607164:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c958e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+21:10538:x1875178192693248:12345-192.168.202.55@tcp:35:lhsmtool_posix.0 Request processed in 1287us (1565us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1788309555.607173:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 31 00000020:00080000:2.0:1788309555.607180:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788309555.607206:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 32 00000100:00100000:2.0:1788309555.607216:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6638c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+20:10537:x1875178192693376:12345-192.168.202.55@tcp:49:lfs.0 00000100:00100000:2.0:1788309555.607343:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6638c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+20:10537:x1875178192693376:12345-192.168.202.55@tcp:49:lfs.0 Request processed in 128us (1678us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309555.607350:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 32 00010000:00010000:1.0:1788309555.608023:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788309555.608035:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628f0d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.608056:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d8000 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:1.0:1788309555.608061:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628f0d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.608071:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628f0d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.608091:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97c8d83f4600) 00010000:00010000:1.0:1788309555.608095:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788309555.608101:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628f0d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.608108:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628f0d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.608133:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309555.608135:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309555.608136:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788309555.610842:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309555.610973:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192693632 00000100:00100000:0.0:1788309555.610988:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192693632 00000100:00100000:0.0:1788309555.611071:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 128 00000100:00100000:0.0:1788309555.611085:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c958e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+20:10537:x1875178192693632:12345-192.168.202.55@tcp:58:lfs.0 00000040:00080000:0.0:1788309555.611511:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:0.0:1788309555.611628:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c958e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+20:10537:x1875178192693632:12345-192.168.202.55@tcp:58:lfs.0 Request processed in 545us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309555.611637:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 128 00000100:00100000:3.0:1788309555.639010:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309555.639248:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192693760 00000100:00100000:1.0:1788309555.639262:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192693760 00000100:00100000:1.0:1788309555.639411:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 129 00000100:00100000:1.0:1788309555.639427:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecdad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+20:10540:x1875178192693760:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:1.0:1788309555.639466:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788309555.639678:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549200/0x63a04852f4628f14 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ab90 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.639812:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549000/0x63a04852f4628f1b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.639831:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549000/0x63a04852f4628f1b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.639854:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549000/0x63a04852f4628f1b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.639874:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628f22 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.639882:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628f22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.639889:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628f22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.640264:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548c00/0x63a04852f4628f29 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.640306:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f4628e34 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab51 expref: 21 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.640316:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548c00/0x63a04852f4628f29 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.640360:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f4628e34 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab51 expref: 21 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309555.640389:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f4628e34 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab51 expref: 21 pid: 5839 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309555.640406:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8f524d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1875178210529152:192.168.202.55@tcp:104: 00000100:00100000:0.0:1788309555.641023:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8e0686f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788309555.644014:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309555.644159:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192694016 00000100:00100000:2.0:1788309555.644172:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192694016 00000100:00100000:2.0:1788309555.644252:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 33 00000100:00100000:2.0:1788309555.644265:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f524ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+22:5589:x1875178192694016:12345-192.168.202.55@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788309555.644683:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f524ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+23:5589:x1875178192694016:12345-192.168.202.55@tcp:35:ldlm_bl.0 Request processed in 419us (682us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1788309555.644693:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 33 00000100:00100000:0.0:1788309555.645255:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8f524d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1875178210529152:192.168.202.55@tcp:104: 00010000:00010000:0.0:1788309555.645325:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548c00/0x63a04852f4628f29 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309555.649334:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309555.649656:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192694144 00000100:00100000:2.0:1788309555.649671:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192694144 00010000:00010000:2.0:1788309555.649788:0:8447:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f4628e34 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab51 expref: 23 pid: 5839 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309555.649883:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 58 00000100:00100000:2.0:1788309555.649896:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6586300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+23:2350:x1875178192694144:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788309555.649916:0:8447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788309555.649925:0:8447:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f4628e34 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab51 expref: 23 pid: 5839 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.649943:0:8447:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f4628e34 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab51 expref: 23 pid: 5839 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.649973:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f4628e34 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab51 expref: 23 pid: 5839 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.650020:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97c8d83f4100) 00010000:00010000:2.0:1788309555.650027:0:8447:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548c00/0x63a04852f4628f29 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.650038:0:8447:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548c00/0x63a04852f4628f29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.650046:0:8447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548c00/0x63a04852f4628f29 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309555.650130:0:8447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788309555.650206:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6586300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+22:2350:x1875178192694144:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 312us (885us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309555.650214:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 58 00010000:00010000:0.0:1788309555.651877:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548c00/0x63a04852f4628f29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309555.651921:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548c00/0x63a04852f4628f29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788309555.651987:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788309555.651993:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788309555.652019:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548c00/0x63a04852f4628f29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309555.652038:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548c00/0x63a04852f4628f29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309555.652050:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549000/0x63a04852f4628f1b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309555.652058:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549000/0x63a04852f4628f1b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309555.652065:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549000/0x63a04852f4628f1b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309555.652072:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8f5549000 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:0.0:1788309555.652076:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549000/0x63a04852f4628f1b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309555.652085:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549000/0x63a04852f4628f1b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309555.652102:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97c8d832f400) 00010000:00010000:0.0:1788309555.652105:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788309555.652111:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549000/0x63a04852f4628f1b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309555.652129:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549000/0x63a04852f4628f1b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309555.652150:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628f22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309555.652155:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628f22 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309555.652160:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628f22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309555.652165:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8f5548000 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:0.0:1788309555.652168:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628f22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309555.652173:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628f22 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309555.652181:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97c8d832f700) 00010000:00010000:0.0:1788309555.652183:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788309555.652186:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628f22 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309555.652191:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628f22 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309555.652245:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549200/0x63a04852f4628f14 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab90 expref: 22 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309555.652262:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548c00/0x63a04852f4628f29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab90 expref: 21 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309555.652333:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97c8d83f4100) 00010000:00010000:0.0:1788309555.652337:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788309555.652340:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8f5548c00, rc 0) 00000100:00100000:0.0:1788309555.652428:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecdad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+21:10540:x1875178192693760:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 13003us (13431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309555.652437:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 129 00010000:00010000:1.0:1788309555.938850:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788309556.444882:0:12095:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788309556.444898:0:12095:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788309556.444953:0:12095:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788309556.444960:0:12095:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1788309556.641350:0:11678:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788309556.641375:0:11678:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788309556.641445:0:11678:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788309556.641454:0:11678:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788309556.641638:0:11678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e6585c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11678:1875178210529280:192.168.202.55@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788309556.641769:0:11678:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c2c400c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788309556.648519:0:11678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e6585c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11678:1875178210529280:192.168.202.55@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788309556.648969:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309556.649109:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192694272 00000100:00100000:3.0:1788309556.649119:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192694272 00000100:00100000:3.0:1788309556.649218:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 130 00000100:00100000:3.0:1788309556.649230:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f524ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+21:10552:x1875178192694272:12345-192.168.202.55@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788309556.649298:0:5838:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788309556.649441:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f524ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+21:10552:x1875178192694272:12345-192.168.202.55@tcp:53:lhsmtool_posix.0 Request processed in 212us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309556.649466:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 130 00000100:00080000:1.0:1788309556.649939:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788309556.656706:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309556.656929:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192694528 00000100:00100000:3.0:1788309556.656941:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192694528 00000100:00100000:3.0:1788309556.657022:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 131 00000100:00100000:3.0:1788309556.657037:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecdaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+21:10552:x1875178192694528:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788309556.657068:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309556.657101:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628f30 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ab97 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309556.657251:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4628f37 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309556.657270:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4628f37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309556.657310:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4628f37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788309556.657324:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788309556.658002:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628f30 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab97 expref: 24 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309556.658029:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4628f37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab97 expref: 23 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309556.658040:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97c8d83f4100) 00010000:00010000:3.0:1788309556.658043:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788309556.658054:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8c153a000, rc 0) 00000100:00100000:3.0:1788309556.658142:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecdaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+23:10552:x1875178192694528:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 1108us (1449us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1788309556.658151:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 131 00000100:00100000:3.0:1788309556.666565:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309556.667452:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192694784 00000100:00100000:1.0:1788309556.667467:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192694784 00000100:00100000:1.0:1788309556.667557:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 132 00000100:00100000:1.0:1788309556.667570:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecdafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+23:10552:x1875178192694784:12345-192.168.202.55@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788309556.667681:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628f45 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309556.667703:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628f45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309556.667717:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628f45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309556.667949:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628f45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309556.667958:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628f45 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309556.667966:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628f45 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309556.667972:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8f5548e00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:1.0:1788309556.667977:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628f45 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309556.667986:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628f45 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309556.668013:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97c8d83f4100) 00010000:00010000:1.0:1788309556.668016:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788309556.668020:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628f45 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309556.668028:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628f45 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309556.668198:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecdafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+24:10552:x1875178192694784:12345-192.168.202.55@tcp:57:lhsmtool_posix.0 Request processed in 629us (1646us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1788309556.668206:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 132 00000040:00080000:1.0:1788309556.668350:0:11678:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788309556.668355:0:11678:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788309556.668905:0:11678:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1788309556.668914:0:11678:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788309556.672251:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309556.672374:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192694912 00000100:00100000:3.0:1788309556.672388:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192694912 00000100:00100000:3.0:1788309556.672480:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 9 00000100:00100000:3.0:1788309556.672494:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6585c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+24:2350:x1875178192694912:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788309556.672515:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788309556.672547:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4628f37 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab97 expref: 24 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309556.672572:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97c8d83f4100) 00010000:00010000:3.0:1788309556.672577:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788309556.672661:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6585c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+23:2350:x1875178192694912:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 169us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309556.672669:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 9 00000100:00100000:0.0:1788309556.675840:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309556.680190:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192695168 00000100:00100000:3.0:1788309556.680213:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192695168 00000100:00100000:3.0:1788309556.680320:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 34 00000100:00100000:3.0:1788309556.680586:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6585f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+23:10552:x1875178192695168:12345-192.168.202.55@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788309556.680957:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6585f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+24:10552:x1875178192695168:12345-192.168.202.55@tcp:35:lhsmtool_posix.0 Request processed in 623us (5128us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1788309556.685968:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 34 00010000:00010000:1.0:1788309556.971809:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309557.984732:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788309558.339564:0:12147:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788309558.339579:0:12147:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788309558.339629:0:12147:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788309558.339635:0:12147:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788309558.585449:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309558.585680:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192695424 00000100:00100000:2.0:1788309558.585692:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192695424 00000100:00100000:2.0:1788309558.585830:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 133 00000100:00100000:2.0:1788309558.585841:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecdace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+24:10572:x1875178192695424:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:2.0:1788309558.585869:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309558.585891:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628f4c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ab9e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309558.585987:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628f53 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309558.586001:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628f53 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309558.586014:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628f53 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788309558.586037:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788309558.586155:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8e00/0x63a04852f4628f4c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab9e expref: 27 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309558.586173:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628f53 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab9e expref: 26 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309558.586182:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97c8d83f4100) 00010000:00010000:2.0:1788309558.586185:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788309558.586188:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8e26d8000, rc 0) 00000100:00100000:2.0:1788309558.586263:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecdace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+26:10572:x1875178192695424:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 423us (831us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1788309558.586270:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 133 00000100:00080000:1.0:1788309558.587683:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788309558.591843:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309558.591976:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192695552 00000100:00100000:3.0:1788309558.591986:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192695552 00000100:00100000:3.0:1788309558.592046:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 134 00000100:00100000:3.0:1788309558.592057:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f524d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+26:10572:x1875178192695552:12345-192.168.202.55@tcp:54:lfs.0 00010000:00010000:3.0:1788309558.592125:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628f61 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309558.592142:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628f61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309558.592153:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628f61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309558.592179:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628f61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309558.592186:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628f61 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309558.592191:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628f61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309558.592197:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8c153a200 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:3.0:1788309558.592202:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628f61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309558.592209:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628f61 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309558.592247:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97c8d83f4100) 00010000:00010000:3.0:1788309558.592250:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788309558.592255:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628f61 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309558.592261:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628f61 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309558.592382:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f524d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+26:10572:x1875178192695552:12345-192.168.202.55@tcp:54:lfs.0 Request processed in 326us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309558.592389:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 134 00000100:00100000:3.0:1788309558.707769:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309558.708431:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192695680 00000100:00100000:2.0:1788309558.708443:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192695680 00000100:00100000:2.0:1788309558.708530:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 45 00000100:00100000:2.0:1788309558.708542:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecdadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:2350:x1875178192695680:12345-192.168.202.55@tcp:101:cat.0 00010000:00010000:2.0:1788309558.708560:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309558.708582:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bfa15baf/0x63a04852f4628f68 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146aba5 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788309558.708611:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a977032, atime: 0x6a977032, ctime: 0x6a977032, blocks: 0xb 00010000:00010000:2.0:1788309558.708637:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=321s v=(0 0) 00010000:00010000:2.0:1788309558.708642:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788309558.708652:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bfa15baf/0x63a04852f4628f68 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aba5 expref: 7 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788309558.708682:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788309558.708693:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bfa15baf/0x63a04852f4628f68 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aba5 expref: 7 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309558.708719:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8e26d8e00, rc 0) 00000100:00100000:2.0:1788309558.708789:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecdadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+7:2350:x1875178192695680:12345-192.168.202.55@tcp:101:cat.0 Request processed in 249us (1031us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309558.708797:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 45 00000100:00100000:1.0:1788309558.712628:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309558.712736:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192695808 00000100:00100000:3.0:1788309558.712746:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192695808 00002000:00100000:3.0:1788309558.712798:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff97c8efefbb80 x1875178192695808/t0(0) o3->86451057-f8bb-4d7c-a7c2-5c834b43e3d3@192.168.202.55@tcp:714/0 lens 488/0 e 0 to 0 dl 1788309569 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788309558.712809:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97c8efefbb80 with x1875178192695808 ext(0->4095) 00002000:00010000:3.0:1788309558.712814:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97c8efefbb80 00000100:00100000:3.0:1788309558.712847:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 3 00000100:00100000:3.0:1788309558.712857:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8efefbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+7:2352:x1875178192695808:12345-192.168.202.55@tcp:3:cat.0 00000100:00100000:3.0:1788309558.713094:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8efefbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+7:2352:x1875178192695808:12345-192.168.202.55@tcp:3:cat.0 Request processed in 238us (476us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788309558.713102:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 3 00002000:00100000:3.0:1788309558.713121:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff97c8efefbb80 x1875178192695808/t0(0) o3->86451057-f8bb-4d7c-a7c2-5c834b43e3d3@192.168.202.55@tcp:714/0 lens 488/4536 e 0 to 0 dl 1788309569 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788309558.713137:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97c8efefbb80 with x1875178192695808 ext(0->4095) 00002000:00010000:3.0:1788309558.713146:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97c8efefbb80 00000100:00100000:1.0:1788309558.752776:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e667d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875178210529536:0@lo:400:kworker.0 00000100:00100000:1.0:1788309558.752862:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309558.752940:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8f5246300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875178210530048:0@lo:400:kworker.0 00000100:00100000:1.0:1788309558.752970:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309558.753003:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788309558.753009:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8f5244380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875178210529664:0@lo:400:kworker.0 00000100:00100000:1.0:1788309558.753031:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309558.753067:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210530048 00000100:00100000:1.0:1788309558.753088:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210530048 00000100:00100000:1.0:1788309558.753150:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788309558.753160:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffcab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3302:x1875178210530048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309558.753232:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffcab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3302:x1875178210530048:12345-0@lo:400:kworker.0 Request processed in 73us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309558.753239:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788309558.753315:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8f5246300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875178210530048:0@lo:400:kworker.0 00000100:00100000:2.0:1788309558.753522:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8f5244700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210529792:0@lo:400:kworker.0 00000100:00100000:2.0:1788309558.753553:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309558.753588:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788309558.753594:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e667f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3300:1875178210529408:0@lo:400:kworker.0 00000100:00100000:2.0:1788309558.753622:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309558.753646:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8f5244000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875178210529920:0@lo:400:kworker.0 00000100:00100000:2.0:1788309558.753666:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309558.753701:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210529408 00000100:00100000:2.0:1788309558.753705:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210529408 00000100:00100000:2.0:1788309558.753737:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1788309558.753744:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:3300:x1875178210529408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309558.753780:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:3300:x1875178210529408:12345-0@lo:400:kworker.0 Request processed in 37us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309558.753786:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1788309558.753822:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e667f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3300:1875178210529408:0@lo:400:kworker.0 00000100:00100000:2.0:1788309558.753843:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210529536 00000100:00100000:2.0:1788309558.753855:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210529536 00000100:00100000:2.0:1788309558.753880:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210529664 00000100:00100000:2.0:1788309558.753883:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210529664 00000100:00100000:2.0:1788309558.753911:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210529920 00000100:00100000:2.0:1788309558.753914:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210529920 00000100:00100000:2.0:1788309558.753930:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788309558.753935:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8efef8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875178210529536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309558.753969:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8efef8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875178210529536:12345-0@lo:400:kworker.0 Request processed in 33us (1107us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309558.753975:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788309558.753986:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788309558.753992:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffca9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875178210529664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309558.754019:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffca9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875178210529664:12345-0@lo:400:kworker.0 Request processed in 28us (987us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309558.754025:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788309558.754035:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788309558.754040:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8eff0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875178210529920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309558.754071:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8eff0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875178210529920:12345-0@lo:400:kworker.0 Request processed in 31us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309558.754077:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788309558.754102:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8f5244000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875178210529920:0@lo:400:kworker.0 00000100:00080000:0.0:1788309558.754332:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788309558.754337:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788309558.758681:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8f5244380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875178210529664:0@lo:400:kworker.0 00000100:00100000:1.0:1788309558.758701:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e667d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875178210529536:0@lo:400:kworker.0 00000100:00100000:1.0:1788309558.758744:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210529792 00000100:00100000:1.0:1788309558.758751:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210529792 00000100:00100000:1.0:1788309558.758832:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788309558.758842:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8eff0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3300:x1875178210529792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309558.758947:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8eff0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3300:x1875178210529792:12345-0@lo:400:kworker.0 Request processed in 106us (5393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309558.758955:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788309558.759100:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8f5244700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210529792:0@lo:400:kworker.0 00000100:00080000:0.0:1788309558.759186:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788309559.008529:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788309559.244622:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309559.244670:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309559.244706:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309559.244731:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309559.246019:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192695936 00000100:00100000:3.0:1788309559.246032:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192695936 00000100:00100000:3.0:1788309559.246186:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 290 00000100:00100000:3.0:1788309559.246196:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8351692-8d1a-4b41-bdaf-bf179786ff59+13:2350:x1875178192695936:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788309559.246339:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8351692-8d1a-4b41-bdaf-bf179786ff59+13:2350:x1875178192695936:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 144us (1728us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309559.246356:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 290 00000100:00100000:0.0:1788309559.246930:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192696064 00000100:00100000:0.0:1788309559.246937:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192696064 00000100:00100000:0.0:1788309559.246990:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192696320 00000100:00100000:0.0:1788309559.247010:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192696320 00000100:00100000:0.0:1788309559.247048:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 137 00000100:00100000:0.0:1788309559.247056:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffca9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+26:2350:x1875178192696064:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788309559.247099:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffca9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+26:2350:x1875178192696064:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 44us (2392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309559.247106:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 137 00000100:00100000:0.0:1788309559.247130:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 138 00000100:00100000:0.0:1788309559.247138:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffcab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ea7f0717-c12d-4408-bdfd-5a035f695b73+5:2350:x1875178192696320:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788309559.247158:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192696192 00000100:00100000:3.0:1788309559.247162:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192696192 00000100:00100000:0.0:1788309559.247176:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffcab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ea7f0717-c12d-4408-bdfd-5a035f695b73+5:2350:x1875178192696320:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 39us (2444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309559.247182:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 138 00000100:00100000:3.0:1788309559.247195:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 77 00000100:00100000:3.0:1788309559.247202:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffcaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+7:2350:x1875178192696192:12345-192.168.202.55@tcp:400:kworker.0 00000100:00080000:0.0:1788309559.247205:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788309559.247209:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788309559.247230:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffcaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+7:2350:x1875178192696192:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 29us (2560us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309559.247237:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 77 00000004:00080000:2.0:1788309559.266446:0:8088:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 322017166347ns, next at 323017163331ns, rc = 0 00000100:00100000:0.0:1788309559.266519:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788309559.266543:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875178210530176:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788309559.266616:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309559.266776:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210530176 00000100:00100000:2.0:1788309559.266785:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210530176 00000100:00100000:2.0:1788309559.266838:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788309559.266862:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6587100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1875178210530176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788309559.266898:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788309559.266946:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6587100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1875178210530176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309559.266953:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788309559.267022:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875178210530176:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1788309559.348550:0:6706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:0.0:1788309559.348568:0:6706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:1.0:1788309559.783019:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788309559.783047:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8f5243480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210530304:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788309559.783129:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309559.783193:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210530304 00000100:00100000:1.0:1788309559.783200:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210530304 00000100:00100000:1.0:1788309559.783249:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788309559.783269:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f5241500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875178210530304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788309559.783345:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788309559.783589:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f5241500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875178210530304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 321us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309559.783597:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788309559.783683:0:3301:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1788309559.783690:0:3301:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:2.0:1788309559.783712:0:3301:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97c8f524fb80, transno 4294967304 00000100:00100000:2.0:1788309559.783740:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8f5243480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210530304:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788309560.033662:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788309560.883301:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967411 is committed 00000020:00080000:1.0:1788309560.883314:0:5859:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000004:00080000:1.0:1788309560.883325:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000001:00080000:1.0:1788309560.883346:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:1.0:1788309560.883357:0:5859:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff97c8c35226c0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1788309560.883370:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97c8c3f13000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff97c8c3522b40 00000020:00080000:1.0:1788309560.883373:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97c8c3f13a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff97c8ffa3bc00 00000020:00080000:1.0:1788309560.883402:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1788309560.883593:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:2.0:1788309560.896961:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8f5240700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210530432:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788309560.897048:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309560.897147:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210530432 00000100:00100000:2.0:1788309560.897155:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210530432 00000100:00100000:2.0:1788309560.897213:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788309560.897223:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8eff0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3301:x1875178210530432:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788309560.897478:0:6682:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1788309560.897482:0:6682:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1788309554 -> 1788309554 00002000:00010000:2.0:1788309560.897485:0:6682:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 1788309554 -> 1788309554 00002000:00010000:2.0:1788309560.897488:0:6682:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1788309554 -> 1788309554 00002000:00010000:2.0:1788309560.897490:0:6682:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1788309560.897529:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8eff0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3301:x1875178210530432:12345-0@lo:2:osp-syn-1-0.0 Request processed in 308us (481us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1788309560.897537:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:2.0:1788309560.897558:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1788309560.897601:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97c8f5240700/2, rc 0, transno 4294967312 00000100:00100000:2.0:1788309560.897607:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8f5240700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210530432:0@lo:2:osp-syn-1-0.0 00000001:00080000:3.0:1788309560.922868:0:7639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:3.0:1788309560.922885:0:7639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00010000:00010000:3.0:1788309561.056746:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309562.080552:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309563.107196:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788309563.872666:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e6584e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3302:1875178210530560:0@lo:400:kworker.0 00000100:00100000:0.0:1788309563.872735:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffcd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875178210530816:0@lo:400:kworker.0 00000100:00100000:2.0:1788309563.872789:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309563.872791:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309563.872870:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffcd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875178210531072:0@lo:400:kworker.0 00000100:00100000:2.0:1788309563.872904:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309563.872931:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e6586d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875178210530688:0@lo:400:kworker.0 00000100:00100000:2.0:1788309563.872948:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210530560 00000100:00100000:2.0:1788309563.872960:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210530560 00000100:00100000:3.0:1788309563.872969:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309563.872993:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffcd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210531200:0@lo:400:kworker.0 00000100:00100000:2.0:1788309563.873024:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1788309563.873033:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309563.873040:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:3302:x1875178210530560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309563.873068:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210530816 00000100:00100000:3.0:1788309563.873074:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210530816 00000100:00100000:2.0:1788309563.873123:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:3302:x1875178210530560:12345-0@lo:400:kworker.0 Request processed in 87us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309563.873124:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210531072 00000100:00100000:3.0:1788309563.873130:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210531072 00000100:00100000:2.0:1788309563.873135:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1788309563.873176:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210530688 00000100:00100000:3.0:1788309563.873180:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210530688 00000100:00100000:3.0:1788309563.873198:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788309563.873200:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e6584e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3302:1875178210530560:0@lo:400:kworker.0 00000100:00100000:3.0:1788309563.873208:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffcd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875178210530816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309563.873250:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffcd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875178210530816:12345-0@lo:400:kworker.0 Request processed in 44us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309563.873256:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788309563.873272:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788309563.873322:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8eff0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875178210531072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309563.873350:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8eff0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875178210531072:12345-0@lo:400:kworker.0 Request processed in 72us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309563.873355:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788309563.873366:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788309563.873370:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f5244700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875178210530688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309563.873395:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f5244700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875178210530688:12345-0@lo:400:kworker.0 Request processed in 25us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309563.873401:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788309563.873431:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210531200 00000100:00100000:3.0:1788309563.873434:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210531200 00000100:00100000:3.0:1788309563.873461:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788309563.873467:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f5244380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1875178210531200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309563.873495:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f5244380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1875178210531200:12345-0@lo:400:kworker.0 Request processed in 27us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309563.873501:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:3.0:1788309563.873516:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788309563.873522:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788309563.873548:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e6586d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875178210530688:0@lo:400:kworker.0 00000100:00100000:3.0:1788309563.873564:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:3.0:1788309563.873570:0:3303:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967311 committed transno 4294967311 00000100:00100000:3.0:1788309563.873591:0:3303:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff97c8f5240700 x1875178210530432/t4294967312(4294967312) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788309576 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788309563.873602:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffcd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210531200:0@lo:400:kworker.0 00000100:00100000:0.0:1788309563.874088:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffcd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875178210530816:0@lo:400:kworker.0 00000100:00100000:0.0:1788309563.874105:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788309563.874136:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffcd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210530944:0@lo:400:kworker.0 00000100:00100000:0.0:1788309563.874179:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309563.874243:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210530944 00000100:00100000:0.0:1788309563.874248:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210530944 00000100:00100000:0.0:1788309563.874324:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788309563.874332:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffcd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1875178210530944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309563.874372:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffcd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1875178210530944:12345-0@lo:400:kworker.0 Request processed in 42us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309563.874379:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:0.0:1788309563.874398:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788309563.874414:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffcd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210530944:0@lo:400:kworker.0 00000100:00100000:2.0:1788309563.875267:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffcd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875178210531072:0@lo:400:kworker.0 00000040:00080000:0.0:1788309563.877756:0:11678:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788309563.877769:0:11678:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788309563.878161:0:11678:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:0.0:1788309563.878169:0:11678:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788309563.976350:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309563.976500:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192696448 00000100:00100000:3.0:1788309563.976599:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192696448 00000100:00080000:0.0:1788309563.976671:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788309563.976690:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 135 00000100:00100000:3.0:1788309563.976700:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f5241c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+13:10217:x1875178192696448:12345-192.168.202.55@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788309563.976817:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f5241c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+13:10217:x1875178192696448:12345-192.168.202.55@tcp:60:lhsmtool_posix.0 Request processed in 118us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309563.976823:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 135 00000100:00100000:1.0:1788309563.980609:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309563.982959:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192696704 00000100:00100000:3.0:1788309563.982981:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192696704 00000100:00100000:3.0:1788309563.983234:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 35 00000100:00100000:3.0:1788309563.983250:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f5240a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+13:10217:x1875178192696704:12345-192.168.202.55@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788309563.983957:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f5240a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+14:10217:x1875178192696704:12345-192.168.202.55@tcp:35:lhsmtool_posix.0 Request processed in 709us (3361us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1788309563.983967:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 35 00010000:00010000:1.0:1788309564.129439:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788309564.242624:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309564.242776:0:8305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192696832 00000100:00100000:3.0:1788309564.242790:0:8305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192696832 00000100:00100000:3.0:1788309564.242940:0:8305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 136 00000100:00100000:3.0:1788309564.242953:0:8305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffcd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ea7f0717-c12d-4408-bdfd-5a035f695b73+5:11024:x1875178192696832:12345-192.168.202.55@tcp:101:lsof.0 00010000:00010000:3.0:1788309564.242983:0:8305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309564.243039:0:8305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4628f6f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146abac expref: -99 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309564.243127:0:8305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628f76 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309564.243156:0:8305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628f76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309564.243171:0:8305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628f76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788309564.243523:0:8305:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1788309564.243529:0:8305:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1788309564.243626:0:8305:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628f76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309564.243658:0:8305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4628f6f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146abac expref: 7 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309564.243680:0:8305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628f76 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146abac expref: 6 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309564.243689:0:8305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c8c3d81800) 00010000:00010000:3.0:1788309564.243693:0:8305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788309564.243697:0:8305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8c153a200, rc 0) 00000100:00100000:3.0:1788309564.243784:0:8305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffcd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ea7f0717-c12d-4408-bdfd-5a035f695b73+6:11024:x1875178192696832:12345-192.168.202.55@tcp:101:lsof.0 Request processed in 833us (1176us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309564.243792:0:8305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 136 00000100:00080000:0.0:1788309564.244231:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788309564.356472:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309564.356519:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309564.356566:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309564.356761:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192696960 00000100:00100000:3.0:1788309564.356794:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192696960 00000100:00100000:3.0:1788309564.356868:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 292 00000100:00100000:3.0:1788309564.356881:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8351692-8d1a-4b41-bdaf-bf179786ff59+13:2353:x1875178192696960:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788309564.356986:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8351692-8d1a-4b41-bdaf-bf179786ff59+13:2353:x1875178192696960:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 107us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309564.356994:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 292 00000100:00100000:2.0:1788309564.359198:0:10673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192697216 00000100:00100000:2.0:1788309564.359218:0:10673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192697216 00000100:00100000:2.0:1788309564.359334:0:10673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192697088 00000100:00100000:2.0:1788309564.359338:0:10673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192697088 00000100:00080000:0.0:1788309564.359370:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788309564.359376:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788309564.359377:0:10673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 80 00000100:00100000:2.0:1788309564.359387:0:10673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffcd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:2353:x1875178192697216:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788309564.359495:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 81 00000100:00100000:3.0:1788309564.359506:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffcda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+5:2353:x1875178192697088:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788309564.359598:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffcda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+5:2353:x1875178192697088:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 93us (3030us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309564.359606:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 81 00000100:00100000:2.0:1788309564.359706:0:10673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffcd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:2353:x1875178192697216:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 320us (3185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309564.359713:0:10673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 80 00000100:00100000:0.0:1788309564.384606:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210531328:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788309564.384711:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309564.384937:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210531328 00000100:00100000:3.0:1788309564.384949:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210531328 00000100:00100000:3.0:1788309564.385021:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788309564.385035:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffcd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1875178210531328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788309564.385086:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788309564.388190:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffcd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1875178210531328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3145us (3465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309564.388208:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788309564.388966:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210531328:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788309564.897241:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8f5243480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210531456:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788309564.897376:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309564.898100:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210531456 00000100:00100000:1.0:1788309564.898112:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210531456 00000100:00100000:1.0:1788309564.898256:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788309564.898270:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8eff0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875178210531456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788309564.898363:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788309564.898740:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8eff0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875178210531456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 471us (1362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309564.898749:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788309564.901572:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8f5243480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210531456:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788309565.152959:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788309565.989227:0:7639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000020:00080000:0.0:1788309565.989670:0:5859:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:0.0:1788309565.989697:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:2.0:1788309565.989894:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1788309565.989908:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:0.0:1788309566.178930:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309567.208541:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788309567.821545:0:12352:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 20:39:26 (1788309566) 00010000:00010000:1.0:1788309568.226663:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788309568.992552:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8f524fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875178210531712:0@lo:400:kworker.0 00000100:00100000:1.0:1788309568.992605:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8f52a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210531968:0@lo:400:kworker.0 00000100:00100000:0.0:1788309568.992649:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8f52ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875178210531840:0@lo:400:kworker.0 00000100:00100000:1.0:1788309568.992659:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309568.992741:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8f5243480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3302:1875178210531584:0@lo:400:kworker.0 00000100:00100000:0.0:1788309568.993235:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309568.996733:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309568.996753:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210531968 00000100:00100000:1.0:1788309568.996765:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210531968 00000100:00100000:3.0:1788309568.996786:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8f52ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210532224:0@lo:400:kworker.0 00000100:00100000:1.0:1788309568.996831:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788309568.996836:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309568.996846:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f52a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875178210531968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309568.996911:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f52a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875178210531968:12345-0@lo:400:kworker.0 Request processed in 68us (4253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309568.996918:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788309568.996933:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210532224 00000100:00100000:1.0:1788309568.996936:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210532224 00000100:00100000:1.0:1788309568.996957:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788309568.996963:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f5246300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210532224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309568.997047:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210531840 00000100:00100000:3.0:1788309568.997052:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210531840 00000100:00100000:1.0:1788309568.997068:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f5246300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210532224:12345-0@lo:400:kworker.0 Request processed in 103us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309568.997076:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788309568.997086:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210531712 00000100:00100000:3.0:1788309568.997090:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210531712 00000100:00080000:1.0:1788309568.997097:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788309568.997103:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788309568.997106:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788309568.997117:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788309568.997127:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffcd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875178210531840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309568.997133:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788309568.997144:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f5244000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875178210531712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309568.997170:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffcd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875178210531840:12345-0@lo:400:kworker.0 Request processed in 44us (3934us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309568.997177:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788309568.997265:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f5244000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875178210531712:12345-0@lo:400:kworker.0 Request processed in 114us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309568.997272:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788309568.997331:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8f52a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210531968:0@lo:400:kworker.0 00000100:00100000:1.0:1788309568.997372:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:1.0:1788309568.997377:0:3303:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97c8f5240700, transno 4294967312 00000100:00100000:1.0:1788309568.997455:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8f52ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210532224:0@lo:400:kworker.0 00000100:00100000:1.0:1788309568.997471:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8f524fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875178210531712:0@lo:400:kworker.0 00000100:00100000:2.0:1788309568.998507:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309568.998520:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8f52ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875178210531840:0@lo:400:kworker.0 00000100:00100000:2.0:1788309568.998602:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8f52aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875178210532096:0@lo:400:kworker.0 00000100:00100000:1.0:1788309568.998710:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210531584 00000100:00100000:1.0:1788309568.998716:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210531584 00000100:00100000:1.0:1788309568.998756:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1788309568.998764:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:3302:x1875178210531584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309568.998808:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:3302:x1875178210531584:12345-0@lo:400:kworker.0 Request processed in 45us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309568.998814:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1788309568.998887:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309568.998923:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8f5243480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3302:1875178210531584:0@lo:400:kworker.0 00000100:00100000:3.0:1788309568.998975:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210532096 00000100:00100000:3.0:1788309568.998980:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210532096 00000100:00100000:3.0:1788309568.999029:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00080000:1.0:1788309568.999030:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788309568.999039:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8eff0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875178210532096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309568.999082:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8eff0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875178210532096:12345-0@lo:400:kworker.0 Request processed in 45us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309568.999088:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788309568.999121:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8f52aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875178210532096:0@lo:400:kworker.0 00010000:00010000:3.0:1788309569.248523:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788309569.475874:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309569.475925:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309569.475962:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309569.475996:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309569.476053:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309569.476078:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192697856 00000100:00100000:1.0:1788309569.476091:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192697856 00000100:00100000:0.0:1788309569.476116:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192697600 00000100:00100000:0.0:1788309569.476127:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192697600 00000100:00100000:1.0:1788309569.476178:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192697472 00000100:00100000:1.0:1788309569.476181:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192697472 00000100:00100000:0.0:1788309569.476209:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192697728 00000100:00100000:0.0:1788309569.476215:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192697728 00000100:00100000:1.0:1788309569.476221:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 145 00000100:00100000:1.0:1788309569.476241:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffcd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ea7f0717-c12d-4408-bdfd-5a035f695b73+6:2352:x1875178192697856:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788309569.476318:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 84 00000100:00100000:0.0:1788309569.476331:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffcda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+5:2352:x1875178192697600:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788309569.476418:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffcda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+5:2352:x1875178192697600:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 91us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309569.476427:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 84 00000100:00100000:0.0:1788309569.476447:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 85 00000100:00100000:0.0:1788309569.476455:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ec974700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:2352:x1875178192697728:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788309569.476480:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ec974700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:2352:x1875178192697728:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 27us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309569.476487:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 85 00000100:00100000:1.0:1788309569.476616:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffcd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ea7f0717-c12d-4408-bdfd-5a035f695b73+6:2352:x1875178192697856:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 378us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309569.476623:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 145 00000100:00080000:0.0:1788309569.476680:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788309569.476686:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788309569.476689:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788309569.476710:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 146 00000100:00100000:0.0:1788309569.476721:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffcd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+13:2352:x1875178192697472:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788309569.476774:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffcd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+13:2352:x1875178192697472:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 57us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309569.476784:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 146 00000100:00100000:2.0:1788309569.476956:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192697344 00000100:00100000:2.0:1788309569.476962:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192697344 00000100:00100000:2.0:1788309569.477004:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 294 00000100:00100000:2.0:1788309569.477012:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6aa2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8351692-8d1a-4b41-bdaf-bf179786ff59+13:2352:x1875178192697344:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:2.0:1788309569.477056:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6aa2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8351692-8d1a-4b41-bdaf-bf179786ff59+13:2352:x1875178192697344:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 45us (1197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309569.477062:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 294 00000100:00100000:0.0:1788309569.491703:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309569.491859:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192698112 00000100:00100000:1.0:1788309569.491875:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192698112 00000100:00100000:1.0:1788309569.492728:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 137 00000100:00100000:1.0:1788309569.492743:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ec977b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+13:11290:x1875178192698112:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788309569.492787:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788309569.492817:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548600/0x63a04852f4628f7d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146abb3 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309569.492937:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549000/0x63a04852f4628f84 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309569.492952:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549000/0x63a04852f4628f84 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309569.492966:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549000/0x63a04852f4628f84 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309569.492979:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628f8b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309569.492985:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628f8b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309569.492991:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628f8b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309569.493757:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549200/0x63a04852f4628f92 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309569.493777:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549200/0x63a04852f4628f92 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309569.493785:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549200/0x63a04852f4628f92 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788309569.493804:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1788309569.494068:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549000/0x63a04852f4628f84 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309569.494082:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549000/0x63a04852f4628f84 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309569.494087:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549000/0x63a04852f4628f84 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309569.494093:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8f5549000 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:1.0:1788309569.494097:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549000/0x63a04852f4628f84 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309569.494109:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549000/0x63a04852f4628f84 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309569.494121:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff97c8c3d81e00) 00010000:00010000:1.0:1788309569.494124:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788309569.494129:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549000/0x63a04852f4628f84 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309569.494134:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549000/0x63a04852f4628f84 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309569.494153:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628f8b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309569.494159:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628f8b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309569.494171:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628f8b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309569.494186:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8f5548000 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:1.0:1788309569.494190:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628f8b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309569.494196:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628f8b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309569.494211:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff97c8d832f500) 00010000:00010000:1.0:1788309569.494214:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788309569.494217:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628f8b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309569.494223:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4628f8b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309569.494960:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548600/0x63a04852f4628f7d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146abb3 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309569.494980:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549200/0x63a04852f4628f92 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146abb3 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309569.494987:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97c8c2ab9600) 00010000:00010000:1.0:1788309569.494989:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788309569.494992:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8f5549200, rc 0) 00000100:00100000:1.0:1788309569.495091:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ec977b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+15:11290:x1875178192698112:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 2350us (3400us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1788309569.495099:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 137 00000100:00100000:1.0:1788309569.506906:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ec974000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210532352:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788309569.507024:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309569.507558:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210532352 00000100:00100000:0.0:1788309569.507567:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210532352 00000100:00100000:0.0:1788309569.507644:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788309569.507655:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f52ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875178210532352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788309569.507706:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788309569.507773:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f52ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875178210532352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309569.507781:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788309569.508649:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ec974000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210532352:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788309569.519344:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309569.519397:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309569.520360:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192698240 00000100:00100000:2.0:1788309569.520376:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192698240 00000100:00100000:2.0:1788309569.520452:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 10 00000100:00100000:2.0:1788309569.520468:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6b29c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+15:2353:x1875178192698240:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788309569.520491:0:8447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788309569.520526:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549200/0x63a04852f4628f92 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146abb3 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309569.520552:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97c8c2ab9600) 00010000:00010000:2.0:1788309569.520557:0:8447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788309569.520793:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6b29c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+14:2353:x1875178192698240:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 326us (1464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309569.520801:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 10 00000100:00100000:3.0:1788309569.524751:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192698368 00000100:00100000:3.0:1788309569.524777:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192698368 00000100:00100000:3.0:1788309569.524884:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 138 00000100:00100000:3.0:1788309569.524898:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ec976300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+14:11290:x1875178192698368:12345-192.168.202.55@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788309569.525080:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ec976300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+14:11290:x1875178192698368:12345-192.168.202.55@tcp:59:lhsmtool_posix.0 Request processed in 184us (5680us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309569.525089:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 138 00000040:00080000:3.0:1788309570.018009:0:11678:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788309570.018020:0:11678:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788309570.018488:0:11678:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1788309570.018498:0:11678:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788309570.020378:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8f52a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210532480:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788309570.020460:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309570.020542:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210532480 00000100:00100000:1.0:1788309570.020550:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210532480 00000100:00100000:1.0:1788309570.020604:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788309570.020614:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f52a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875178210532480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788309570.020660:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788309570.020707:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f52a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875178210532480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309570.020714:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:1.0:1788309570.020734:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788309570.020772:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8f52a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210532480:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788309570.275975:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788309571.131821:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00010000:00010000:0.0:1788309571.310537:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788309571.850392:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309571.851866:0:8305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192698496 00000100:00100000:3.0:1788309571.851879:0:8305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192698496 00000100:00100000:3.0:1788309571.851954:0:8305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 139 00000100:00100000:3.0:1788309571.851966:0:8305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f52a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+13:11332:x1875178192698496:12345-192.168.202.55@tcp:101:lfs.0 00000100:00080000:1.0:1788309571.851979:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788309571.851987:0:8305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309571.852008:0:8305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4628fa0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146abba expref: -99 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309571.852071:0:8305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4628fa7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309571.852086:0:8305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4628fa7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309571.852097:0:8305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4628fa7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309571.852113:0:8305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628fae lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309571.852119:0:8305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628fae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309571.852126:0:8305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628fae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309571.852439:0:8305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4628fa7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309571.852448:0:8305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4628fa7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309571.852465:0:8305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4628fa7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309571.852471:0:8305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8c153a000 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:3.0:1788309571.852476:0:8305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4628fa7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309571.852484:0:8305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4628fa7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309571.852496:0:8305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c8c3d81800) 00010000:00010000:3.0:1788309571.852499:0:8305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788309571.852503:0:8305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4628fa7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309571.852509:0:8305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4628fa7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309571.852523:0:8305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628fae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309571.852530:0:8305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628fae lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309571.852535:0:8305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628fae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309571.852540:0:8305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8c153ac00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:3.0:1788309571.852543:0:8305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628fae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309571.852559:0:8305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628fae lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309571.852567:0:8305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff97c8e2544100) 00010000:00010000:3.0:1788309571.852569:0:8305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788309571.852572:0:8305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628fae lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309571.852578:0:8305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628fae lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309571.852724:0:8305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4628fa0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146abba expref: 14 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309571.852735:0:8305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c8c3d81800) 00010000:00010000:3.0:1788309571.852738:0:8305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788309571.852741:0:8305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4628fa0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146abba expref: 14 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309571.852753:0:8305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8c153bc00, rc 0) 00000100:00100000:3.0:1788309571.852830:0:8305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f52a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+13:11332:x1875178192698496:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 866us (2449us total) trans 0 rc 301/301 00000100:00100000:3.0:1788309571.852839:0:8305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 139 00000100:00100000:0.0:1788309571.864190:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309571.867163:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192698752 00000100:00100000:3.0:1788309571.867177:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192698752 00000100:00100000:3.0:1788309571.867252:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 140 00000100:00100000:3.0:1788309571.867263:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ec975c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+13:11332:x1875178192698752:12345-192.168.202.55@tcp:36:lfs.0 00010000:00010000:3.0:1788309571.867355:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788309571.867384:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f462891e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a9f3 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309571.867405:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c8c3d81800) 00010000:00010000:3.0:1788309571.867410:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788309571.867875:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4628fb5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309571.867892:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628f76 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146abac expref: 5 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309571.867900:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4628fb5 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309571.867934:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628f76 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146abac expref: 5 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309571.867952:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628f76 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146abac expref: 5 pid: 8305 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309571.867965:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e697a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1875178210532608:192.168.202.55@tcp:104: 00000100:00100000:3.0:1788309571.868058:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d1280540 going to sleep for 11 seconds 00000100:00100000:3.0:1788309571.869878:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e697a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1875178210532608:192.168.202.55@tcp:104: 00010000:00010000:3.0:1788309571.869903:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4628fb5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309571.870730:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309571.870797:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192698880 00000100:00100000:1.0:1788309571.870805:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192698880 00010000:00010000:1.0:1788309571.870863:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628f76 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146abac expref: 6 pid: 8305 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309571.870902:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 59 00000100:00100000:1.0:1788309571.870913:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ec975880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ea7f0717-c12d-4408-bdfd-5a035f695b73+6:2350:x1875178192698880:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788309571.870926:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788309571.870932:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628f76 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146abac expref: 6 pid: 8305 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309571.870962:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628f76 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146abac expref: 6 pid: 8305 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309571.870983:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4628f76 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146abac expref: 6 pid: 8305 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309571.870999:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c8c3d81800) 00010000:00010000:1.0:1788309571.871004:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4628fb5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309571.871013:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4628fb5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309571.871020:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4628fb5 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309571.871046:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788309571.871071:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4628fb5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309571.871083:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4628fb5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309571.871096:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ec975880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ea7f0717-c12d-4408-bdfd-5a035f695b73+5:2350:x1875178192698880:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 186us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309571.871103:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 59 00010000:00010000:3.0:1788309571.871106:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628fbc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309571.871115:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628fbc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309571.871123:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628fbc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788309571.871523:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:3.0:1788309571.876539:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1788309571.876559:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4628fb5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309571.876570:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4628fb5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309571.876578:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4628fb5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309571.876584:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8c153bc00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:3.0:1788309571.876590:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4628fb5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309571.876598:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4628fb5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309571.876614:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c8c3d81800) 00010000:00010000:3.0:1788309571.876617:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788309571.876629:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4628fb5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309571.876636:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4628fb5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788309571.876660:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000be3c38a9 reply state 00000000b91fd97f transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628fbc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309571.876669:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788309571.876772:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ec975c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+14:11332:x1875178192698752:12345-192.168.202.55@tcp:36:lfs.0 Request processed in 9507us (12585us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1788309571.876782:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 140 00010000:00010000:2.0:1788309571.879226:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628fbc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309571.879254:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628fbc lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309571.879260:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628fbc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309571.879266:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8c153ac00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309571.879270:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628fbc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309571.879302:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628fbc lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309571.879318:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff97c8e2544100) 00010000:00010000:2.0:1788309571.879321:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788309571.879325:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628fbc lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309571.879330:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4628fbc lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309572.003760:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309572.005191:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192699008 00000100:00100000:2.0:1788309572.005205:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192699008 00000100:00100000:2.0:1788309572.005327:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 141 00000100:00100000:2.0:1788309572.005339:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f52abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+13:11341:x1875178192699008:12345-192.168.202.55@tcp:101:lctl.0 00010000:00010000:2.0:1788309572.005377:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309572.005399:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628fc3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146abc1 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309572.005459:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4628fca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309572.005473:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4628fca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309572.005482:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4628fca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788309572.005535:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1788309572.005539:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1788309572.005563:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4628fca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309572.005597:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628fc3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146abc1 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309572.005615:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4628fca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146abc1 expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309572.005623:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c8d83f4800) 00010000:00010000:2.0:1788309572.005626:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788309572.005629:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8e26d8800, rc 0) 00000100:00100000:2.0:1788309572.005685:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f52abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+14:11341:x1875178192699008:12345-192.168.202.55@tcp:101:lctl.0 Request processed in 350us (1936us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309572.005692:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 141 00000100:00100000:0.0:1788309572.088152:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309572.088525:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192699136 00000100:00100000:1.0:1788309572.088542:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192699136 00000100:00100000:1.0:1788309572.088654:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 142 00000100:00100000:1.0:1788309572.088667:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ec974a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+14:11347:x1875178192699136:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:1.0:1788309572.088688:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788309572.088708:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549200/0x63a04852f4628fd1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146abc8 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309572.088786:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628fd8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309572.088802:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628fd8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309572.088814:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628fd8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309572.088828:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548400/0x63a04852f4628fdf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309572.088835:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548400/0x63a04852f4628fdf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309572.088841:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548400/0x63a04852f4628fdf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309572.088959:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548600/0x63a04852f4628fe6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309572.088967:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548600/0x63a04852f4628fe6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309572.088974:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548600/0x63a04852f4628fe6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788309572.089002:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:1.0:1788309572.089005:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788309572.089025:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548600/0x63a04852f4628fe6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309572.089043:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628fd8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309572.089057:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628fd8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309572.089062:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628fd8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309572.089066:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8f5548e00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:1.0:1788309572.089069:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628fd8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309572.089074:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628fd8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309572.089083:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c8d83f4800) 00010000:00010000:1.0:1788309572.089085:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788309572.089088:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628fd8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309572.089092:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4628fd8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309572.089101:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548400/0x63a04852f4628fdf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309572.089104:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548400/0x63a04852f4628fdf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309572.089109:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548400/0x63a04852f4628fdf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309572.089119:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8f5548400 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:1.0:1788309572.089122:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548400/0x63a04852f4628fdf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309572.089128:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548400/0x63a04852f4628fdf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309572.089135:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff97c8d832f500) 00010000:00010000:1.0:1788309572.089137:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788309572.089140:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548400/0x63a04852f4628fdf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309572.089146:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548400/0x63a04852f4628fdf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309572.089181:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549200/0x63a04852f4628fd1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146abc8 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309572.089190:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548600/0x63a04852f4628fe6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146abc8 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309572.089195:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97c8d832f200) 00010000:00010000:1.0:1788309572.089196:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788309572.089198:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8f5548600, rc 0) 00000100:00100000:1.0:1788309572.089738:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ec974a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+15:11347:x1875178192699136:12345-192.168.202.55@tcp:101:bash.0 Request processed in 1071us (1598us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309572.089746:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 142 00000100:00100000:0.0:1788309572.104641:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309572.104817:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192699392 00000100:00100000:2.0:1788309572.104828:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192699392 00000100:00100000:2.0:1788309572.104896:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 143 00000100:00100000:2.0:1788309572.104907:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ec975180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+15:11347:x1875178192699392:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:2.0:1788309572.104928:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309572.104950:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4628fed lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146abcf expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309572.105094:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628ff4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309572.105110:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628ff4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309572.105121:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628ff4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309572.105135:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4628ffb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309572.105142:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4628ffb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309572.105148:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4628ffb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788309572.106064:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1788309572.106215:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9600/0x63a04852f4629002 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309572.106238:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9600/0x63a04852f4629002 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309572.106257:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9600/0x63a04852f4629002 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309572.107091:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628ff4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309572.107098:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628ff4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309572.107104:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628ff4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309572.107110:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d9c00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309572.107114:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628ff4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309572.107121:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628ff4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309572.107133:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97c8d832f200) 00010000:00010000:2.0:1788309572.107135:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788309572.107140:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628ff4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309572.107145:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4628ff4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788309572.107160:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000030f987 reply state 00000000aae6b194 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4628ffb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309572.107169:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788309572.107218:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4628fed lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146abcf expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309572.107244:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9600/0x63a04852f4629002 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146abcf expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309572.107251:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c8d83f4b00) 00010000:00010000:2.0:1788309572.107254:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788309572.107256:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8e26d9600, rc 0) 00000100:00100000:2.0:1788309572.107667:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ec975180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+18:11347:x1875178192699392:12345-192.168.202.55@tcp:101:bash.0 Request processed in 2759us (3034us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1788309572.107676:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 143 00010000:00010000:3.0:1788309572.109854:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4628ffb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309572.109870:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4628ffb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309572.109877:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4628ffb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309572.109883:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d8600 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:3.0:1788309572.109888:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4628ffb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309572.109895:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4628ffb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309572.109910:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97c8d83f4f00) 00010000:00010000:3.0:1788309572.109913:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788309572.109918:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4628ffb lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309572.109936:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4628ffb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309572.114137:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309572.114408:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192699520 00000100:00100000:3.0:1788309572.114419:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192699520 00000100:00100000:3.0:1788309572.114502:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 47 00000100:00100000:3.0:1788309572.114515:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ec975f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+5:2353:x1875178192699520:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:3.0:1788309572.114537:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309572.114563:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040bb116f/0x63a04852f4629010 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146abd6 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788309572.114785:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788309572.114811:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=334s v=(0 0) 00010000:00010000:3.0:1788309572.114817:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788309572.114828:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040bb116f/0x63a04852f4629010 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146abd6 expref: 6 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309572.114851:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000040bb116f/0x63a04852f4629010 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146abd6 expref: 6 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309572.114865:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8c153bc00, rc 0) 00000100:00100000:3.0:1788309572.114980:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ec975f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:2353:x1875178192699520:12345-192.168.202.55@tcp:101:bash.0 Request processed in 467us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309572.114988:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 47 00000100:00080000:0.0:1788309572.115204:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788309572.125778:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309572.125878:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192699648 00000100:00100000:1.0:1788309572.125901:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192699648 00000100:00100000:1.0:1788309572.125960:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 48 00000100:00100000:1.0:1788309572.125970:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ec686680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:11347:x1875178192699648:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:1.0:1788309572.125989:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788309572.126010:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e00f599/0x63a04852f4629017 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146abdd expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309572.126041:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000040bb116f/0x63a04852f4629010 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146abd6 expref: 7 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309572.126049:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788309572.126053:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788309572.126059:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e00f599/0x63a04852f4629017 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146abdd expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309572.126091:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000040bb116f/0x63a04852f4629010 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146abd6 expref: 7 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309572.126105:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000040bb116f/0x63a04852f4629010 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146abd6 expref: 7 pid: 6682 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309572.126119:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8f52a8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6681:1875178210532736:192.168.202.55@tcp:104: 00000100:00100000:1.0:1788309572.127103:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c8b5e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788309572.129953:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8f52a8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6681:1875178210532736:192.168.202.55@tcp:104: 00010000:00010000:1.0:1788309572.129993:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001e00f599/0x63a04852f4629017 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146abdd expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309572.130036:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8f5548400, rc 0) 00000100:00100000:1.0:1788309572.130100:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ec686680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+7:11347:x1875178192699648:12345-192.168.202.55@tcp:101:bash.0 Request processed in 4130us (4330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309572.130110:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 48 00000100:00100000:0.0:1788309572.133559:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309572.133856:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192699776 00000100:00100000:2.0:1788309572.133868:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192699776 00010000:00010000:2.0:1788309572.133914:0:8447:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000040bb116f/0x63a04852f4629010 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146abd6 expref: 7 pid: 6682 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309572.133961:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 60 00000100:00100000:2.0:1788309572.133972:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ec974e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+7:2350:x1875178192699776:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788309572.133988:0:8447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788309572.134013:0:8447:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000040bb116f/0x63a04852f4629010 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146abd6 expref: 7 pid: 6682 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309572.134027:0:8447:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000040bb116f/0x63a04852f4629010 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146abd6 expref: 7 pid: 6682 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309572.134065:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040bb116f/0x63a04852f4629010 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146abd6 expref: 7 pid: 6682 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309572.134085:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788309572.134089:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788309572.134098:0:8447:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001e00f599/0x63a04852f4629017 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146abdd expref: 6 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309572.134108:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e00f599/0x63a04852f4629017 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146abdd expref: 6 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309572.134146:0:8447:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000001e00f599/0x63a04852f4629017 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146abdd expref: 6 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309572.134162:0:8447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e6585500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8447:1875178210532864:192.168.202.55@tcp:105: 00000100:00100000:2.0:1788309572.134514:0:8447:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8ffb80a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788309572.141208:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309572.141304:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192700032 00000100:00100000:3.0:1788309572.141314:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192700032 00000100:00100000:3.0:1788309572.141392:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 36 00000100:00100000:3.0:1788309572.141401:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6586300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+17:11347:x1875178192700032:12345-192.168.202.55@tcp:35:bash.0 00000100:00100000:3.0:1788309572.141773:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6586300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+18:11347:x1875178192700032:12345-192.168.202.55@tcp:35:bash.0 Request processed in 372us (578us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1788309572.141781:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 36 00000100:00100000:1.0:1788309572.142824:0:8447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e6585500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8447:1875178210532864:192.168.202.55@tcp:105: 00010000:00010000:1.0:1788309572.142848:0:8447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788309572.142899:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ec974e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:2350:x1875178192699776:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 8928us (9350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309572.142909:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 60 00000100:00100000:2.0:1788309572.247934:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309572.248099:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192700288 00000100:00100000:3.0:1788309572.248111:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192700288 00000100:00100000:3.0:1788309572.248180:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 144 00000100:00100000:3.0:1788309572.248190:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6585c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+18:11357:x1875178192700288:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:3.0:1788309572.248215:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309572.248246:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f462901e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146abe4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788309572.248415:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1788309572.248550:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f462901e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146abe4 expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309572.248791:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c8d83f4800) 00010000:00010000:3.0:1788309572.248796:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788309572.248802:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f462901e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146abe4 expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309572.248819:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8c153a000, rc 0) 00000100:00100000:3.0:1788309572.248894:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6585c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+19:11357:x1875178192700288:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 705us (972us total) trans 4294967419 rc 301/301 00000100:00100000:3.0:1788309572.248901:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 144 00000100:00100000:2.0:1788309572.251596:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309572.251698:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192700544 00000100:00100000:3.0:1788309572.251718:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192700544 00000100:00100000:3.0:1788309572.251770:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 37 00000100:00100000:3.0:1788309572.251780:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6586d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+19:11357:x1875178192700544:12345-192.168.202.55@tcp:35:lfs.0 00000100:00100000:3.0:1788309572.252008:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6586d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+20:11357:x1875178192700544:12345-192.168.202.55@tcp:35:lfs.0 Request processed in 229us (422us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1788309572.252016:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 37 00010000:00010000:1.0:1788309572.320890:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788309572.363395:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309572.363498:0:8305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192700672 00000100:00100000:3.0:1788309572.363508:0:8305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192700672 00000100:00100000:3.0:1788309572.363575:0:8305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 145 00000100:00100000:3.0:1788309572.363594:0:8305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ec977100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+20:11363:x1875178192700672:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:3.0:1788309572.363621:0:8305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309572.363644:0:8305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f462902c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146abeb expref: -99 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309572.363715:0:8305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4629033 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309572.363729:0:8305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4629033 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309572.363740:0:8305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4629033 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788309572.363801:0:8305:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:3.0:1788309572.363806:0:8305:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1788309572.363829:0:8305:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4629033 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309572.363855:0:8305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f462902c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146abeb expref: 22 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309572.363893:0:8305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4629033 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146abeb expref: 21 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309572.363902:0:8305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97c8d832f200) 00010000:00010000:3.0:1788309572.363905:0:8305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788309572.363909:0:8305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8c153bc00, rc 0) 00000100:00100000:3.0:1788309572.363975:0:8305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ec977100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+21:11363:x1875178192700672:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 384us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309572.363981:0:8305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 145 00000100:00100000:1.0:1788309572.373151:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309572.373540:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192700928 00000100:00100000:3.0:1788309572.373551:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192700928 00000100:00100000:3.0:1788309572.373830:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 146 00000100:00100000:3.0:1788309572.373843:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f52a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+21:11363:x1875178192700928:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:3.0:1788309572.373871:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309572.373894:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f462903a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146abf2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309572.374002:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4629041 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309572.374017:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4629041 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309572.374029:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4629041 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788309572.374041:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788309572.374812:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f462903a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146abf2 expref: 24 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309572.374833:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4629041 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146abf2 expref: 23 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309572.374841:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c8d83f4b00) 00010000:00010000:3.0:1788309572.374845:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788309572.374847:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8c153ac00, rc 0) 00000100:00100000:3.0:1788309572.374958:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f52a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+23:11363:x1875178192700928:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 1118us (1818us total) trans 4294967421 rc 0/0 00000100:00100000:3.0:1788309572.374966:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 146 00000100:00100000:2.0:1788309572.382121:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309572.382272:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192701184 00000100:00100000:2.0:1788309572.382712:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309572.382757:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192701184 00000100:00100000:1.0:1788309572.382857:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 147 00000100:00100000:1.0:1788309572.382868:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6584e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+23:11363:x1875178192701184:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:1.0:1788309572.382893:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788309572.382914:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549000/0x63a04852f462904f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146abf9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309572.383006:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f4629056 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309572.383020:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f4629056 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309572.383031:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f4629056 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788309572.383066:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788309572.383345:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549000/0x63a04852f462904f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146abf9 expref: 26 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309572.383365:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f4629056 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146abf9 expref: 25 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309572.383375:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c8d83f4b00) 00010000:00010000:1.0:1788309572.383378:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788309572.383380:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8f5548800, rc 0) 00000100:00100000:1.0:1788309572.383436:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6584e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+25:11363:x1875178192701184:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 570us (1396us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1788309572.383443:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 147 00000100:00100000:0.0:1788309572.383590:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192701312 00000100:00100000:0.0:1788309572.383595:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192701312 00000100:00100000:0.0:1788309572.383630:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 11 00000100:00100000:0.0:1788309572.383636:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6585500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+25:2351:x1875178192701312:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788309572.383646:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788309572.383659:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4629041 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146abf2 expref: 25 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309572.383672:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c8d83f4b00) 00010000:00010000:0.0:1788309572.383676:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788309572.383694:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6585500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+24:2351:x1875178192701312:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 58us (1525us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309572.383700:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 11 00000100:00100000:0.0:1788309572.391598:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309572.391773:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192701440 00000100:00100000:3.0:1788309572.391784:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192701440 00000100:00100000:3.0:1788309572.391841:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 49 00000100:00100000:3.0:1788309572.391853:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ec976d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:2353:x1875178192701440:12345-192.168.202.55@tcp:1:lfs.0 00010000:00010000:3.0:1788309572.391900:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076b14d99/0x63a04852f4629064 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309572.391921:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001e00f599/0x63a04852f4629017 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146abdd expref: 6 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309572.391930:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788309572.391935:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788309572.391940:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076b14d99/0x63a04852f4629064 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309572.391976:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001e00f599/0x63a04852f4629017 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146abdd expref: 6 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309572.392003:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001e00f599/0x63a04852f4629017 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146abdd expref: 6 pid: 6681 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309572.392019:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e697a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6682:1875178210532992:192.168.202.55@tcp:104: 00000100:00100000:3.0:1788309572.392129:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c60cfc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788309572.396354:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e697a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6682:1875178210532992:192.168.202.55@tcp:104: 00010000:00010000:3.0:1788309572.396385:0:6682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000076b14d99/0x63a04852f4629064 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309572.399184:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309572.399319:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192701568 00000100:00100000:3.0:1788309572.399329:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192701568 00002000:00100000:3.0:1788309572.399388:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff97c8ec976680 x1875178192701568/t0(0) o4->86451057-f8bb-4d7c-a7c2-5c834b43e3d3@192.168.202.55@tcp:728/0 lens 504/0 e 0 to 0 dl 1788309583 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788309572.399399:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97c8ec976680 with x1875178192701568 ext(0->12) 00010000:00010000:3.0:1788309572.399408:0:6688:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000001e00f599/0x63a04852f4629017 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146abdd expref: 7 pid: 6681 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309572.399433:0:6688:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000001e00f599/0x63a04852f4629017 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146abdd expref: 7 pid: 6681 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788309572.399442:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff97c8ec976680 00000100:00100000:3.0:1788309572.399473:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 2 00000100:00100000:3.0:1788309572.399483:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ec976680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+7:2351:x1875178192701568:12345-192.168.202.55@tcp:4:lfs.0 00000100:00100000:3.0:1788309572.400031:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ec976680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+9:2351:x1875178192701568:12345-192.168.202.55@tcp:4:lfs.0 Request processed in 548us (865us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788309572.400040:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 2 00002000:00100000:3.0:1788309572.400047:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff97c8ec976680 x1875178192701568/t4294967305(0) o4->86451057-f8bb-4d7c-a7c2-5c834b43e3d3@192.168.202.55@tcp:728/0 lens 504/448 e 0 to 0 dl 1788309583 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788309572.400055:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97c8ec976680 with x1875178192701568 ext(0->12) 00010000:00010000:3.0:1788309572.400062:0:6688:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000001e00f599/0x63a04852f4629017 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146abdd expref: 9 pid: 6681 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309572.400074:0:6688:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000001e00f599/0x63a04852f4629017 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146abdd expref: 9 pid: 6681 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788309572.400082:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff97c8ec976680 00000100:00100000:2.0:1788309572.404826:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309572.404919:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192701696 00000100:00100000:3.0:1788309572.404928:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192701696 00010000:00010000:3.0:1788309572.404966:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001e00f599/0x63a04852f4629017 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146abdd expref: 9 pid: 6681 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309572.405007:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 61 00000100:00100000:3.0:1788309572.405016:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e667d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+9:2352:x1875178192701696:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788309572.405029:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788309572.405047:0:5821:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788309572.405050:0:5821:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788309572 00002000:00010000:3.0:1788309572.405052:0:5821:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788309572 00002000:00010000:3.0:1788309572.405054:0:5821:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788309572 00010000:00010000:3.0:1788309572.405072:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001e00f599/0x63a04852f4629017 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146abdd expref: 9 pid: 6681 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309572.405085:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001e00f599/0x63a04852f4629017 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146abdd expref: 9 pid: 6681 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309572.405105:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e00f599/0x63a04852f4629017 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146abdd expref: 9 pid: 6681 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309572.405120:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788309572.405125:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788309572.405130:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000076b14d99/0x63a04852f4629064 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309572.405140:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076b14d99/0x63a04852f4629064 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309572.405180:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788309572.405240:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e667d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+8:2352:x1875178192701696:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 224us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309572.405247:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 61 00010000:00010000:0.0:1788309572.405321:0:6682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000076b14d99/0x63a04852f4629064 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309572.405332:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076b14d99/0x63a04852f4629064 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309572.405356:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076b14d99/0x63a04852f4629064 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309572.405364:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076b14d99/0x63a04852f4629064 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309572.405377:0:6682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076b14d99/0x63a04852f4629064 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309572.405384:0:6682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8c153a000 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:0.0:1788309572.405388:0:6682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076b14d99/0x63a04852f4629064 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309572.405396:0:6682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076b14d99/0x63a04852f4629064 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309572.405407:0:6682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076b14d99/0x63a04852f4629064 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309572.405413:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076b14d99/0x63a04852f4629064 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309572.405469:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ec976d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+7:2353:x1875178192701440:12345-192.168.202.55@tcp:1:lfs.0 Request processed in 13618us (13888us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309572.405488:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 49 00000100:00100000:1.0:1788309572.413932:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309572.414015:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192701952 00000100:00100000:3.0:1788309572.414025:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192701952 00000100:00100000:3.0:1788309572.414079:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 38 00000100:00100000:3.0:1788309572.414088:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e663b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+24:11363:x1875178192701952:12345-192.168.202.55@tcp:35:lfs.0 00000004:00010000:3.0:1788309572.414153:0:5840:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f4629056 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146abf9 expref: 24 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788309572.414515:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:3.0:1788309572.414587:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:3.0:1788309572.415121:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:3.0:1788309572.415182:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f462906b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309572.415199:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9600/0x63a04852f4629002 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146abcf expref: 28 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309572.415208:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f462906b lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309572.415257:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9600/0x63a04852f4629002 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146abcf expref: 28 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309572.415271:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9600/0x63a04852f4629002 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146abcf expref: 28 pid: 5839 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309572.415320:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e697a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5840:1875178210533120:192.168.202.55@tcp:104: 00000100:00100000:3.0:1788309572.415416:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c60cf180 going to sleep for 11 seconds 00000100:00100000:3.0:1788309572.419373:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e697a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5840:1875178210533120:192.168.202.55@tcp:104: 00010000:00010000:3.0:1788309572.419406:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f462906b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309572.421519:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309572.421725:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192702080 00000100:00100000:0.0:1788309572.421734:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192702080 00010000:00010000:0.0:1788309572.421775:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9600/0x63a04852f4629002 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146abcf expref: 29 pid: 5839 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309572.421819:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 62 00000100:00100000:0.0:1788309572.421845:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f52aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+29:2350:x1875178192702080:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788309572.421859:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788309572.421866:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9600/0x63a04852f4629002 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146abcf expref: 29 pid: 5839 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309572.421879:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9600/0x63a04852f4629002 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146abcf expref: 29 pid: 5839 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309572.421900:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9600/0x63a04852f4629002 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146abcf expref: 29 pid: 5839 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309572.421918:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c8d83f4b00) 00010000:00010000:0.0:1788309572.421923:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f462906b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309572.421932:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f462906b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309572.421939:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f462906b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309572.421968:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788309572.422022:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f52aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+28:2350:x1875178192702080:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 181us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309572.422029:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 62 00010000:00010000:3.0:1788309572.422781:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f462906b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309572.422791:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f462906b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788309572.422922:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:3.0:1788309572.423139:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:3.0:1788309572.423313:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e697a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5840:1875178210533248:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788309572.423374:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309572.423403:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c60cf480 going to sleep for 11 seconds 00000100:00100000:0.0:1788309572.423780:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210533248 00000100:00100000:0.0:1788309572.423787:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210533248 00000100:00100000:0.0:1788309572.423847:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788309572.423855:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecfd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5840:x1875178210533248:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788309572.423940:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecfd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5840:x1875178210533248:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 86us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309572.423947:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788309572.423984:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e697a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5840:1875178210533248:0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:2.0:1788309572.424807:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1788309572.424944:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:0.0:1788309572.425010:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ec977480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5840:1875178210533376:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788309572.425074:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309572.425463:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8e0686f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788309572.427373:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210533376 00000100:00100000:2.0:1788309572.427385:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210533376 00000100:00100000:2.0:1788309572.427459:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788309572.427470:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ec974380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5840:x1875178210533376:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788309572.428039:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ec974380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5840:x1875178210533376:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 571us (2963us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788309572.428057:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788309572.428220:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ec977480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5840:1875178210533376:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788309572.428517:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:0.0:1788309572.428782:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f462906b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309572.428794:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f462906b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309572.428802:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f462906b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309572.428808:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8c153a200 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:0.0:1788309572.428813:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f462906b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309572.428822:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f462906b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309572.428838:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c8d83f4b00) 00010000:00010000:0.0:1788309572.428840:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788309572.428854:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f462906b lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309572.428860:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f462906b lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788309572.429064:0:5840:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788309572.429456:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:0.0:1788309572.429468:0:5840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 335180189731ns, next at 336180187586ns, rc = 0 00000001:00080000:0.0:1788309572.429662:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:0.0:1788309572.429707:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c8d83f4b00) 00010000:00010000:0.0:1788309572.429711:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788309572.429718:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f4629056 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146abf9 expref: 32 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309572.429833:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e663b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+31:11363:x1875178192701952:12345-192.168.202.55@tcp:35:lfs.0 Request processed in 15744us (15910us total) trans 4294967431 rc 0/0 00000100:00100000:0.0:1788309572.429842:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 38 00000020:00080000:0.0:1788309572.429847:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788309572.433476:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309572.433688:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192702208 00000100:00100000:0.0:1788309572.433698:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192702208 00000100:00100000:0.0:1788309572.433778:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 148 00000100:00100000:0.0:1788309572.433788:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f52a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+31:11363:x1875178192702208:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:0.0:1788309572.433810:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788309572.433834:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e400/0x63a04852f4629072 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ac00 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309572.433890:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e400/0x63a04852f4629072 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac00 expref: 32 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309572.433920:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e400/0x63a04852f4629072 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac00 expref: 32 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309572.433940:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c8c2ab9700) 00010000:00010000:0.0:1788309572.433943:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788309572.433946:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8ecf2e400, rc 0) 00000100:00100000:0.0:1788309572.434006:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f52a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+32:11363:x1875178192702208:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 219us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309572.434012:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 148 00000100:00100000:2.0:1788309572.441122:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309572.441314:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192702464 00000100:00100000:1.0:1788309572.441326:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192702464 00000100:00100000:1.0:1788309572.441389:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 39 00000100:00100000:1.0:1788309572.441401:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e667f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+32:11363:x1875178192702464:12345-192.168.202.55@tcp:35:lfs.0 00000100:00100000:1.0:1788309572.441703:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e667f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+33:11363:x1875178192702464:12345-192.168.202.55@tcp:35:lfs.0 Request processed in 303us (591us total) trans 4294967432 rc 0/0 00000100:00100000:1.0:1788309572.441711:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 39 00000100:00100000:1.0:1788309572.565439:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309572.565651:0:8305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192702720 00000100:00100000:3.0:1788309572.565663:0:8305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192702720 00000100:00100000:3.0:1788309572.565744:0:8305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 149 00000100:00100000:3.0:1788309572.565755:0:8305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f52a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+33:11373:x1875178192702720:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:3.0:1788309572.565792:0:8305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309572.565815:0:8305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4629079 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ac07 expref: -99 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788309572.565954:0:8305:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1788309572.566088:0:8305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4629079 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac07 expref: 35 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309572.566103:0:8305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c8d83f4800) 00010000:00010000:3.0:1788309572.566106:0:8305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788309572.566112:0:8305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4629079 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac07 expref: 35 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309572.566125:0:8305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8c153a200, rc 0) 00000100:00100000:3.0:1788309572.566444:0:8305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f52a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+34:11373:x1875178192702720:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 690us (1014us total) trans 4294967433 rc 301/301 00000100:00100000:3.0:1788309572.566451:0:8305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 149 00000100:00100000:2.0:1788309572.569733:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309572.569810:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192702848 00000100:00100000:3.0:1788309572.569821:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192702848 00000100:00100000:3.0:1788309572.569882:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 150 00000100:00100000:3.0:1788309572.569892:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc91ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+34:11373:x1875178192702848:12345-192.168.202.55@tcp:34:lfs.0 00010000:00010000:3.0:1788309572.569966:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4629087 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309572.569981:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4629087 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309572.569992:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4629087 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309572.570005:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f462908e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309572.570012:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f462908e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309572.570018:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f462908e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309572.570113:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f4629095 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309572.570122:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f4629095 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309572.570129:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f4629095 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788309572.570167:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f4629095 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309572.570206:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4629087 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309572.570212:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4629087 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309572.570218:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4629087 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309572.570233:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8c153a000 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:3.0:1788309572.570237:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4629087 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309572.570244:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4629087 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309572.570257:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97c8d832f200) 00010000:00010000:3.0:1788309572.570259:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788309572.570263:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4629087 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309572.571363:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4629087 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309572.571385:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f462908e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309572.571392:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f462908e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309572.571399:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f462908e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309572.571413:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8c153ac00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:3.0:1788309572.571416:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f462908e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309572.571422:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f462908e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309572.571433:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97c8e2544200) 00010000:00010000:3.0:1788309572.571436:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788309572.571440:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f462908e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309572.571445:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f462908e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309572.571461:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f4629095 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309572.571468:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f4629095 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309572.571485:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f4629095 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309572.571489:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8d73ef800 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:3.0:1788309572.571492:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f4629095 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309572.571497:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f4629095 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309572.571515:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c8c2ab9700) 00010000:00010000:3.0:1788309572.571517:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788309572.571519:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f4629095 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309572.571525:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f4629095 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309572.571621:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc91ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+34:11373:x1875178192702848:12345-192.168.202.55@tcp:34:lfs.0 Request processed in 1728us (1906us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309572.571629:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 150 00000100:00100000:0.0:1788309572.575212:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309572.575567:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192703104 00000100:00100000:1.0:1788309572.575592:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192703104 00000100:00100000:1.0:1788309572.575974:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 40 00000100:00100000:1.0:1788309572.575985:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ec976a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+34:11373:x1875178192703104:12345-192.168.202.55@tcp:35:lfs.0 00000100:00100000:1.0:1788309572.576647:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ec976a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+35:11373:x1875178192703104:12345-192.168.202.55@tcp:35:lfs.0 Request processed in 662us (1443us total) trans 4294967434 rc 0/0 00000100:00100000:1.0:1788309572.576656:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 40 00000100:00100000:1.0:1788309572.615361:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309572.615567:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192703360 00000100:00100000:2.0:1788309572.615577:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192703360 00000100:00100000:2.0:1788309572.615645:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 151 00000100:00100000:2.0:1788309572.615656:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f52a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+35:11376:x1875178192703360:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:2.0:1788309572.615684:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309572.615704:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f462909c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ac0e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309572.615779:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f46290a3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309572.615793:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f46290a3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309572.615802:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f46290a3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309572.615812:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f46290aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309572.615816:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f46290aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309572.615833:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f46290aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309572.615946:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f46290b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309572.615951:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f46290b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309572.615956:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f46290b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788309572.615963:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788309572.616035:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f46290a3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309572.616040:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f46290a3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309572.616046:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f46290a3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309572.616051:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d9c00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309572.616056:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f46290a3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309572.616063:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f46290a3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309572.616074:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97c8d832f200) 00010000:00010000:2.0:1788309572.616078:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788309572.616088:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f46290a3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309572.616094:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f46290a3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309572.616107:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f46290aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309572.616110:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f46290aa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309572.616114:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f46290aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309572.616117:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d8c00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309572.616118:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f46290aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309572.616122:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f46290aa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309572.616126:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97c8d83f4200) 00010000:00010000:2.0:1788309572.616127:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788309572.616129:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f46290aa lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309572.616132:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f46290aa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309572.616163:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f462909c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac0e expref: 38 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309572.616180:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f46290b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac0e expref: 37 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309572.616185:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c8c2ab9700) 00010000:00010000:2.0:1788309572.616187:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788309572.616188:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8e26d8600, rc 0) 00000100:00100000:2.0:1788309572.616595:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f52a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+37:11376:x1875178192703360:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 940us (1244us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1788309572.616602:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 151 00000100:00100000:2.0:1788309572.621732:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309572.621851:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192703488 00000100:00100000:1.0:1788309572.621860:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192703488 00000100:00100000:1.0:1788309572.621922:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 152 00000100:00100000:1.0:1788309572.621932:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc91ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+37:11376:x1875178192703488:12345-192.168.202.55@tcp:54:lfs.0 00010000:00010000:1.0:1788309572.622049:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549200/0x63a04852f46290bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309572.622065:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549200/0x63a04852f46290bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309572.622077:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549200/0x63a04852f46290bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309572.622105:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549200/0x63a04852f46290bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309572.622113:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549200/0x63a04852f46290bf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309572.622117:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549200/0x63a04852f46290bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309572.622122:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8f5549200 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:1.0:1788309572.622137:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549200/0x63a04852f46290bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309572.622142:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549200/0x63a04852f46290bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309572.622152:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c8c2ab9700) 00010000:00010000:1.0:1788309572.622154:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788309572.622157:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549200/0x63a04852f46290bf lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309572.622161:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549200/0x63a04852f46290bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309572.622307:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc91ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+37:11376:x1875178192703488:12345-192.168.202.55@tcp:54:lfs.0 Request processed in 374us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309572.622314:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 152 00000100:00100000:0.0:1788309572.626822:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309572.626930:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192703744 00000100:00100000:3.0:1788309572.626941:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192703744 00000100:00100000:3.0:1788309572.627038:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 41 00000100:00100000:3.0:1788309572.627050:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ec977800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+37:11376:x1875178192703744:12345-192.168.202.55@tcp:35:lfs.0 00000100:00100000:3.0:1788309572.627452:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ec977800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+38:11376:x1875178192703744:12345-192.168.202.55@tcp:35:lfs.0 Request processed in 405us (639us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1788309572.627458:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 41 00000100:00100000:2.0:1788309572.988669:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309572.988815:0:8305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192704000 00000100:00100000:0.0:1788309572.988825:0:8305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192704000 00000100:00100000:0.0:1788309572.988892:0:8305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 153 00000100:00100000:0.0:1788309572.988903:0:8305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8edf31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+38:11407:x1875178192704000:12345-192.168.202.55@tcp:101:cat.0 00010000:00010000:0.0:1788309572.988927:0:8305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788309572.989101:0:8305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f800/0x63a04852f46290c6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ac15 expref: -99 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309572.989204:0:8305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e200/0x63a04852f46290cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309572.989230:0:8305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e200/0x63a04852f46290cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309572.989242:0:8305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e200/0x63a04852f46290cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788309572.989374:0:8305:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788309572.989501:0:8305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f800/0x63a04852f46290c6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac15 expref: 41 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309572.989524:0:8305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e200/0x63a04852f46290cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac15 expref: 40 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309572.989533:0:8305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c8c2ab9700) 00010000:00010000:0.0:1788309572.989536:0:8305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788309572.989540:0:8305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8ecf2e200, rc 0) 00000100:00100000:0.0:1788309572.989803:0:8305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8edf31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+40:11407:x1875178192704000:12345-192.168.202.55@tcp:101:cat.0 Request processed in 901us (1145us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1788309572.989811:0:8305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 153 00000100:00100000:2.0:1788309572.995562:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309572.995656:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309572.995742:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192704256 00000100:00100000:3.0:1788309572.995747:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192704384 00000100:00100000:3.0:1788309572.995752:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192704384 00000100:00100000:1.0:1788309572.995752:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192704256 00000100:00100000:3.0:1788309572.995849:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 12 00000100:00100000:3.0:1788309572.995870:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8edf33b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+41:2352:x1875178192704384:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788309572.995888:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788309572.995916:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e200/0x63a04852f46290cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac15 expref: 41 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309572.995959:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c8c2ab9700) 00010000:00010000:3.0:1788309572.995964:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788309572.996022:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8edf33b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+40:2352:x1875178192704384:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 163us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309572.996029:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 12 00000100:00100000:1.0:1788309572.996114:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 42 00000100:00100000:1.0:1788309572.996123:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8edf30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+39:11407:x1875178192704256:12345-192.168.202.55@tcp:35:cat.0 00000100:00100000:1.0:1788309572.996372:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8edf30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+40:11407:x1875178192704256:12345-192.168.202.55@tcp:35:cat.0 Request processed in 250us (910us total) trans 4294967438 rc 0/0 00000100:00100000:1.0:1788309572.996379:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 42 00000100:00100000:2.0:1788309573.087080:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309573.087185:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192704640 00000100:00100000:3.0:1788309573.087194:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192704640 00000100:00100000:3.0:1788309573.087319:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 154 00000100:00100000:3.0:1788309573.087342:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8edf30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+40:11413:x1875178192704640:12345-192.168.202.55@tcp:101:dd.0 00010000:00010000:3.0:1788309573.087366:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309573.087370:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788309573.087398:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4629033 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146abeb expref: 40 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309573.087419:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97c8d832f200) 00010000:00010000:3.0:1788309573.087424:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788309573.087438:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f46290db lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ac1c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309573.087561:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f46290e2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309573.087585:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f46290b1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac0e expref: 40 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309573.087594:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f46290e2 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309573.087634:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f46290b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac0e expref: 40 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309573.087646:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f46290b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac0e expref: 40 pid: 5839 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309573.087660:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecfd3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1875178210533504:192.168.202.55@tcp:104: 00000100:00100000:3.0:1788309573.087748:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d1280540 going to sleep for 11 seconds 00000100:00080000:2.0:1788309573.088526:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1788309573.089521:0:11678:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788309573.089527:0:11678:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788309573.089895:0:11678:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:1.0:1788309573.089902:0:11678:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788309573.095095:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309573.095196:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192704768 00000100:00100000:0.0:1788309573.095206:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192704768 00010000:00010000:0.0:1788309573.095307:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f46290b1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac0e expref: 41 pid: 5839 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309573.095358:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 63 00000100:00100000:0.0:1788309573.095371:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6b2a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+41:2350:x1875178192704768:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788309573.095386:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788309573.095392:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f46290b1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac0e expref: 41 pid: 5839 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309573.095406:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f46290b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac0e expref: 41 pid: 5839 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309573.095445:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c8c2ab9700) 00010000:00010000:0.0:1788309573.095451:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f46290e2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309573.095461:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f46290e2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309573.095469:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f46290e2 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309573.095795:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788309573.095870:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6b2a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+41:2350:x1875178192704768:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 502us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309573.095878:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 63 00010000:00010000:3.0:1788309573.096156:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f46290b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac0e expref: 40 pid: 5839 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309573.096186:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecfd3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1875178210533504:192.168.202.55@tcp:104: 00010000:00010000:3.0:1788309573.096206:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f46290e2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309573.096215:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f46290e2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309573.096231:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f46290e2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788309573.096253:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788309573.096884:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f46290db lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac1c expref: 41 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309573.096903:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f46290e2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac1c expref: 40 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309573.096927:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c8c2ab9700) 00010000:00010000:3.0:1788309573.096930:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788309573.096933:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8d73ee400, rc 0) 00000100:00100000:3.0:1788309573.096968:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8edf30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+40:11413:x1875178192704640:12345-192.168.202.55@tcp:101:dd.0 Request processed in 9638us (9898us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1788309573.096975:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 154 00000100:00100000:0.0:1788309573.103639:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309573.103977:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192705024 00000100:00100000:2.0:1788309573.103988:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192705024 00000100:00100000:2.0:1788309573.104060:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 155 00000100:00100000:2.0:1788309573.104071:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ec975880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+40:11413:x1875178192705024:12345-192.168.202.55@tcp:36:dd.0 00010000:00010000:2.0:1788309573.104824:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f46290f0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309573.104878:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f46290f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309573.104891:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f46290f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788309573.104961:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:2.0:1788309573.104987:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d933ef5f reply state 0000000016043f03 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f46290f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309573.104997:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788309573.105546:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ec975880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+43:11413:x1875178192705024:12345-192.168.202.55@tcp:36:dd.0 Request processed in 1472us (1913us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1788309573.105554:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 155 00000020:00080000:2.0:1788309573.105560:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788309573.115881:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f46290f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309573.115901:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f46290f0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309573.115910:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f46290f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309573.115916:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d8c00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309573.115921:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f46290f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309573.115928:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f46290f0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309573.115946:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c8c2ab9700) 00010000:00010000:2.0:1788309573.115949:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788309573.115955:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f46290f0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309573.115960:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f46290f0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309573.345484:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788309573.434754:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309573.435081:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192705152 00000100:00100000:1.0:1788309573.435104:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192705152 00000100:00100000:1.0:1788309573.435167:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 156 00000100:00100000:1.0:1788309573.435178:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ec974e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+42:11427:x1875178192705152:12345-192.168.202.55@tcp:101:stat.0 00010000:00010000:1.0:1788309573.435202:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788309573.435253:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549200/0x63a04852f46290f7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ac23 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309573.435369:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f46290fe lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309573.435386:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f46290fe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309573.435397:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f46290fe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309573.435412:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4629105 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309573.435419:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4629105 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309573.435424:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4629105 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309573.435520:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f462910c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309573.435531:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f46290e2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac1c expref: 43 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309573.435540:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f462910c lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309573.435593:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f46290e2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac1c expref: 43 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309573.435606:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f46290e2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac1c expref: 43 pid: 5838 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309573.435619:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8f52a9180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1875178210533632:192.168.202.55@tcp:104: 00000100:00100000:1.0:1788309573.435904:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c8b5ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1788309573.443756:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309573.444170:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192705408 00000100:00100000:1.0:1788309573.444180:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192705408 00000100:00100000:1.0:1788309573.444248:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 43 00000100:00100000:1.0:1788309573.444259:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecfd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+44:5589:x1875178192705408:12345-192.168.202.55@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788309573.444593:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecfd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+45:5589:x1875178192705408:12345-192.168.202.55@tcp:35:ldlm_bl.0 Request processed in 336us (846us total) trans 4294967442 rc 0/0 00000100:00100000:1.0:1788309573.444602:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 43 00000100:00100000:0.0:1788309573.445354:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8f52a9180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1875178210533632:192.168.202.55@tcp:104: 00010000:00010000:0.0:1788309573.445384:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f462910c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309573.452536:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309573.452641:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192705536 00000100:00100000:2.0:1788309573.452651:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192705536 00010000:00010000:2.0:1788309573.452693:0:8447:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f46290e2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac1c expref: 45 pid: 5838 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309573.452737:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 64 00000100:00100000:2.0:1788309573.452747:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f52a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+45:2350:x1875178192705536:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788309573.452762:0:8447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788309573.452769:0:8447:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f46290e2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac1c expref: 45 pid: 5838 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309573.452780:0:8447:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f46290e2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac1c expref: 45 pid: 5838 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309573.452799:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f46290e2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac1c expref: 45 pid: 5838 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309573.452816:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c8c2ab9700) 00010000:00010000:2.0:1788309573.452821:0:8447:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f462910c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309573.452831:0:8447:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f462910c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309573.452839:0:8447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f462910c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309573.452872:0:8447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788309573.452946:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f52a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+44:2350:x1875178192705536:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 200us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309573.452954:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 64 00010000:00010000:0.0:1788309573.453065:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f462910c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309573.453085:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f462910c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788309573.453153:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788309573.453179:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788309573.453239:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f462910c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309573.453271:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f462910c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309573.453360:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f46290fe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309573.453368:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f46290fe lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309573.453374:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f46290fe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309573.453396:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8f5548e00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:0.0:1788309573.453401:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f46290fe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309573.453410:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f46290fe lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309573.453420:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97c8d832f200) 00010000:00010000:0.0:1788309573.453434:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788309573.453437:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f46290fe lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309573.453443:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f46290fe lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309573.453468:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4629105 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309573.453475:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4629105 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309573.453487:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4629105 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309573.453493:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8f5548000 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:0.0:1788309573.453495:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4629105 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309573.453526:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4629105 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309573.453535:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97c8d832f500) 00010000:00010000:0.0:1788309573.453538:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788309573.453541:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4629105 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309573.453557:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4629105 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309573.453636:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549200/0x63a04852f46290f7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac23 expref: 44 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309573.453663:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f462910c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac23 expref: 43 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309573.453671:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c8c2ab9700) 00010000:00010000:0.0:1788309573.453673:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788309573.453675:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8f5548800, rc 0) 00000100:00100000:0.0:1788309573.453737:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ec974e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+43:11427:x1875178192705152:12345-192.168.202.55@tcp:101:stat.0 Request processed in 18561us (19003us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309573.453764:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 156 00000100:00100000:1.0:1788309573.525753:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309573.526334:0:8305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192705792 00000100:00100000:0.0:1788309573.526344:0:8305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192705792 00000100:00100000:0.0:1788309573.526398:0:8305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 157 00000100:00100000:0.0:1788309573.526406:0:8305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f52a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+43:11433:x1875178192705792:12345-192.168.202.55@tcp:36:truncate.0 00010000:00010000:0.0:1788309573.526661:0:8305:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788309573.526687:0:8305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f462910c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac23 expref: 43 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309573.526702:0:8305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c8c2ab9700) 00010000:00010000:0.0:1788309573.526705:0:8305:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788309573.526898:0:8305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f400/0x63a04852f4629113 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309573.526912:0:8305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f400/0x63a04852f4629113 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309573.526923:0:8305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f400/0x63a04852f4629113 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788309573.526975:0:8305:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:0.0:1788309573.526999:0:8305:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000848ea186 reply state 0000000072d343d7 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f400/0x63a04852f4629113 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309573.527008:0:8305:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788309573.527105:0:8305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f52a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+45:11433:x1875178192705792:12345-192.168.202.55@tcp:36:truncate.0 Request processed in 698us (1360us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1788309573.527113:0:8305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 157 00000020:00080000:0.0:1788309573.527133:0:8305:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788309573.532642:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f400/0x63a04852f4629113 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309573.532656:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f400/0x63a04852f4629113 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309573.532661:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f400/0x63a04852f4629113 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309573.532666:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8ecf2f400 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:3.0:1788309573.532669:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f400/0x63a04852f4629113 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309573.532673:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f400/0x63a04852f4629113 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309573.532688:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c8c2ab9700) 00010000:00010000:3.0:1788309573.532690:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788309573.532693:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f400/0x63a04852f4629113 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309573.532713:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f400/0x63a04852f4629113 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309573.757615:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309573.757795:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192705920 00000100:00100000:3.0:1788309573.757806:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192705920 00000100:00100000:3.0:1788309573.757877:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 158 00000100:00100000:3.0:1788309573.757888:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f52ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+44:11446:x1875178192705920:12345-192.168.202.55@tcp:101:stat.0 00010000:00010000:3.0:1788309573.757914:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309573.757938:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f462911a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ac2a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309573.758011:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f4629121 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309573.758027:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f4629121 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309573.758039:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f4629121 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309573.758053:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4629128 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309573.758059:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4629128 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309573.758064:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4629128 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309573.758163:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f462912f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309573.758186:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f462912f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309573.758193:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f462912f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788309573.758377:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1788309573.758382:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788309573.758402:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f462912f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309573.758416:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f462912f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309573.758425:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f4629121 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309573.758431:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f4629121 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309573.758437:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f4629121 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309573.758443:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8d73ef800 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:3.0:1788309573.758447:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f4629121 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309573.758455:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f4629121 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309573.758467:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97c8d832f200) 00010000:00010000:3.0:1788309573.758477:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788309573.758482:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f4629121 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309573.758494:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f4629121 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309573.758510:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4629128 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309573.758516:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4629128 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309573.758521:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4629128 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309573.758526:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8d73eee00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:3.0:1788309573.758528:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4629128 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309573.758533:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4629128 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309573.758541:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97c8e2544c00) 00010000:00010000:3.0:1788309573.758543:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788309573.758545:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4629128 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309573.758551:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4629128 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309573.758746:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f462911a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac2a expref: 46 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309573.758774:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f462912f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac2a expref: 45 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309573.758782:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c8c2ab9700) 00010000:00010000:3.0:1788309573.758784:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788309573.758787:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8d73ee400, rc 0) 00000100:00100000:3.0:1788309573.758904:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f52ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+45:11446:x1875178192705920:12345-192.168.202.55@tcp:101:stat.0 Request processed in 1016us (1298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309573.758912:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 158 00000100:00100000:2.0:1788309573.925883:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309573.926272:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192706176 00000100:00100000:1.0:1788309573.926309:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192706176 00000100:00100000:1.0:1788309573.926370:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 159 00000100:00100000:1.0:1788309573.926381:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8edf32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+45:11457:x1875178192706176:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:1.0:1788309573.926401:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788309573.926420:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548400/0x63a04852f4629136 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ac31 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788309573.926549:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1788309573.927175:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548400/0x63a04852f4629136 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac31 expref: 47 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309573.927192:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c8d83f4800) 00010000:00010000:1.0:1788309573.927195:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788309573.927201:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548400/0x63a04852f4629136 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac31 expref: 47 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309573.927225:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8f5548400, rc 0) 00000100:00100000:1.0:1788309573.927341:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8edf32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+46:11457:x1875178192706176:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 961us (1477us total) trans 4294967445 rc 301/301 00000100:00100000:1.0:1788309573.927349:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 159 00000100:00100000:1.0:1788309573.937050:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309573.937150:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192706432 00000100:00100000:2.0:1788309573.937160:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192706432 00000100:00100000:2.0:1788309573.937252:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 44 00000100:00100000:2.0:1788309573.937264:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6639c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+46:11457:x1875178192706432:12345-192.168.202.55@tcp:35:lfs.0 00000100:00100000:2.0:1788309573.938091:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6639c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+47:11457:x1875178192706432:12345-192.168.202.55@tcp:35:lfs.0 Request processed in 827us (1050us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1788309573.938102:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 44 00000100:00100000:3.0:1788309574.033055:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309574.033259:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192706688 00000100:00100000:0.0:1788309574.033272:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192706688 00000100:00100000:0.0:1788309574.033408:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 160 00000100:00100000:0.0:1788309574.033422:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecfd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+47:11463:x1875178192706688:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:0.0:1788309574.033460:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788309574.033504:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f000/0x63a04852f4629144 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ac38 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.033858:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f462914b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.033878:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f462912f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac2a expref: 48 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.033888:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f462914b lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.033940:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f462912f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac2a expref: 48 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.033958:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f462912f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac2a expref: 48 pid: 5838 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309574.033974:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ec975500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1875178210533760:192.168.202.55@tcp:104: 00000100:00100000:0.0:1788309574.034107:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c60cfc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788309574.045508:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ec975500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1875178210533760:192.168.202.55@tcp:104: 00010000:00010000:0.0:1788309574.045555:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f462914b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309574.050984:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309574.051823:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192706816 00000100:00100000:0.0:1788309574.051840:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192706816 00010000:00010000:0.0:1788309574.051900:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f462912f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac2a expref: 49 pid: 5838 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309574.051953:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 65 00000100:00100000:0.0:1788309574.051966:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecfd1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+49:2350:x1875178192706816:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788309574.051987:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788309574.051996:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f462912f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac2a expref: 49 pid: 5838 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.052013:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f462912f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac2a expref: 49 pid: 5838 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.052044:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f462912f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac2a expref: 49 pid: 5838 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.052070:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c8c2ab9700) 00010000:00010000:0.0:1788309574.052076:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f462914b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.052103:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f462914b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.052111:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f462914b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.052453:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788309574.052693:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecfd1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+48:2350:x1875178192706816:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 725us (1720us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309574.052703:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 65 00010000:00010000:3.0:1788309574.052946:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f462914b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309574.052957:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f462914b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788309574.052982:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:3.0:1788309574.054025:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f000/0x63a04852f4629144 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac38 expref: 49 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309574.054059:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f462914b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac38 expref: 48 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309574.054069:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c8c2ab9700) 00010000:00010000:3.0:1788309574.054072:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788309574.054103:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8ecf2ec00, rc 0) 00000100:00100000:3.0:1788309574.054558:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecfd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+48:11463:x1875178192706688:12345-192.168.202.55@tcp:101:bash.0 Request processed in 21137us (22089us total) trans 4294967447 rc 0/0 00000100:00100000:3.0:1788309574.054568:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 160 00000100:00100000:3.0:1788309574.062366:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309574.062430:0:8305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192707072 00000100:00100000:0.0:1788309574.062449:0:8305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192707072 00000100:00100000:0.0:1788309574.062599:0:8305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 161 00000100:00100000:0.0:1788309574.062612:0:8305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecfd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+48:11463:x1875178192707072:12345-192.168.202.55@tcp:36:bash.0 00010000:00010000:0.0:1788309574.062983:0:8305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f400/0x63a04852f4629159 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.063004:0:8305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f400/0x63a04852f4629159 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.063018:0:8305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f400/0x63a04852f4629159 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788309574.063098:0:8305:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:0.0:1788309574.063128:0:8305:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000da4f56f0 reply state 00000000f2410381 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f400/0x63a04852f4629159 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309574.063139:0:8305:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788309574.063606:0:8305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecfd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+51:11463:x1875178192707072:12345-192.168.202.55@tcp:36:bash.0 Request processed in 993us (1248us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1788309574.063615:0:8305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 161 00000020:00080000:0.0:1788309574.063622:0:8305:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788309574.075530:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f400/0x63a04852f4629159 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.075556:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f400/0x63a04852f4629159 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.075589:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f400/0x63a04852f4629159 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.075597:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8ecf2f400 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:0.0:1788309574.075604:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f400/0x63a04852f4629159 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.075613:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f400/0x63a04852f4629159 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.075637:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c8c2ab9700) 00010000:00010000:0.0:1788309574.075641:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788309574.075648:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f400/0x63a04852f4629159 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.075655:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f400/0x63a04852f4629159 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309574.100923:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309574.101051:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192707200 00000100:00100000:0.0:1788309574.101063:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192707200 00000100:00100000:0.0:1788309574.101157:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 162 00000100:00100000:0.0:1788309574.101169:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f52aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+50:11463:x1875178192707200:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:0.0:1788309574.101201:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788309574.101240:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f400/0x63a04852f4629160 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ac3f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.101393:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f800/0x63a04852f4629167 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.101410:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f462914b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac38 expref: 51 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.101440:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f800/0x63a04852f4629167 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309574.101818:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f462914b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac38 expref: 51 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309574.101844:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f462914b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac38 expref: 51 pid: 5838 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309574.101873:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ec975500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1875178210533888:192.168.202.55@tcp:104: 00000100:00100000:3.0:1788309574.101991:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c60cfc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788309574.104991:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ec975500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1875178210533888:192.168.202.55@tcp:104: 00010000:00010000:1.0:1788309574.105025:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f800/0x63a04852f4629167 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309574.112510:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309574.113039:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8edf30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3302:1875178210534016:0@lo:400:kworker.0 00000100:00100000:3.0:1788309574.113096:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309574.113138:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8edf31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875178210534528:0@lo:400:kworker.0 00000100:00100000:3.0:1788309574.113185:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309574.113221:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788309574.113229:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8edf31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875178210534144:0@lo:400:kworker.0 00000100:00100000:3.0:1788309574.113252:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309574.113297:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8edf31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875178210534656:0@lo:400:kworker.0 00000100:00100000:3.0:1788309574.113320:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309574.113348:0:10673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210534656 00000100:00100000:3.0:1788309574.113355:0:10673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210534656 00000100:00100000:3.0:1788309574.113412:0:10673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788309574.113422:0:10673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffbb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1875178210534656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309574.113478:0:10673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffbb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1875178210534656:12345-0@lo:400:kworker.0 Request processed in 57us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309574.113485:0:10673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:3.0:1788309574.113503:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788309574.113528:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8edf31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875178210534656:0@lo:400:kworker.0 00000100:00100000:2.0:1788309574.113747:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210534016 00000100:00100000:2.0:1788309574.113752:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210534016 00000100:00100000:2.0:1788309574.113790:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1788309574.113797:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6a6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:3302:x1875178210534016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309574.113832:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6a6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:3302:x1875178210534016:12345-0@lo:400:kworker.0 Request processed in 37us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309574.113838:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1788309574.113926:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8edf31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875178210534272:0@lo:400:kworker.0 00000100:00100000:1.0:1788309574.113955:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309574.113986:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788309574.113991:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8edf30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210534400:0@lo:400:kworker.0 00000100:00100000:1.0:1788309574.114014:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309574.114051:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210534400 00000100:00100000:1.0:1788309574.114054:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210534400 00000100:00100000:1.0:1788309574.114087:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788309574.114094:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f52aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3300:x1875178210534400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309574.114129:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f52aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3300:x1875178210534400:12345-0@lo:400:kworker.0 Request processed in 37us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309574.114135:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:1.0:1788309574.114154:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788309574.114233:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8edf30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210534400:0@lo:400:kworker.0 00000100:00100000:0.0:1788309574.114382:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192707328 00000100:00100000:0.0:1788309574.114396:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192707328 00010000:00010000:0.0:1788309574.114452:0:8447:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f462914b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac38 expref: 52 pid: 5838 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309574.114505:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 66 00000100:00100000:0.0:1788309574.114518:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f52aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+52:2350:x1875178192707328:12345-192.168.202.55@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788309574.114519:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210534528 00000100:00100000:1.0:1788309574.114528:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210534528 00010000:00010000:0.0:1788309574.114538:0:8447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788309574.114550:0:8447:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f462914b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac38 expref: 52 pid: 5838 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788309574.114555:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788309574.114569:0:8447:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f462914b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac38 expref: 52 pid: 5838 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.114597:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f462914b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac38 expref: 52 pid: 5838 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.114617:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c8c2ab9700) 00010000:00010000:0.0:1788309574.114622:0:8447:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f800/0x63a04852f4629167 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.114633:0:8447:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f800/0x63a04852f4629167 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309574.114649:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210534144 00000100:00100000:2.0:1788309574.114659:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210534144 00010000:00010000:0.0:1788309574.114664:0:8447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f800/0x63a04852f4629167 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309574.114688:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210534272 00000100:00100000:2.0:1788309574.114693:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210534272 00010000:00010000:0.0:1788309574.114702:0:8447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788309574.114721:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788309574.114730:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffbb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875178210534144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309574.114776:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f52aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+51:2350:x1875178192707328:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 259us (2274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309574.114786:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffbb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875178210534144:12345-0@lo:400:kworker.0 Request processed in 52us (1527us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309574.114795:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 66 00000100:00100000:2.0:1788309574.114805:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788309574.114846:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00010000:00010000:0.0:1788309574.114848:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f800/0x63a04852f4629167 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309574.114861:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f52a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875178210534272:12345-0@lo:400:kworker.0 00010000:00010000:0.0:1788309574.114865:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f800/0x63a04852f4629167 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309574.114904:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f52a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875178210534272:12345-0@lo:400:kworker.0 Request processed in 49us (947us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309574.114910:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000004:00200000:0.0:1788309574.114927:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788309574.114934:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788309574.114959:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f800/0x63a04852f4629167 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309574.114989:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8edf31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875178210534272:0@lo:400:kworker.0 00010000:00010000:0.0:1788309574.115001:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f400/0x63a04852f4629160 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac3f expref: 51 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.115030:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f800/0x63a04852f4629167 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac3f expref: 50 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.115039:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c8c2ab9700) 00010000:00010000:0.0:1788309574.115046:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00000100:00100000:1.0:1788309574.115048:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00010000:00010000:0.0:1788309574.115051:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8ecf2f800, rc 0) 00000100:00100000:1.0:1788309574.115061:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffbb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875178210534528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309574.115102:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f52aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+50:11463:x1875178192707200:12345-192.168.202.55@tcp:101:bash.0 Request processed in 13932us (14190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309574.115111:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffbb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875178210534528:12345-0@lo:400:kworker.0 Request processed in 50us (1922us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309574.115128:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788309574.115137:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 162 00000100:00100000:3.0:1788309574.115604:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8edf31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875178210534144:0@lo:400:kworker.0 00000100:00100000:3.0:1788309574.115616:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8edf30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3302:1875178210534016:0@lo:400:kworker.0 00000100:00100000:3.0:1788309574.115627:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8edf31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875178210534528:0@lo:400:kworker.0 00000100:00100000:2.0:1788309574.127621:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309574.127723:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192707584 00000100:00100000:1.0:1788309574.127734:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192707584 00000100:00100000:1.0:1788309574.127796:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 45 00000100:00100000:1.0:1788309574.127807:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8edf30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+50:11463:x1875178192707584:12345-192.168.202.55@tcp:35:bash.0 00000100:00100000:1.0:1788309574.128752:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8edf30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+51:11463:x1875178192707584:12345-192.168.202.55@tcp:35:bash.0 Request processed in 943us (1190us total) trans 4294967450 rc 0/0 00000100:00100000:1.0:1788309574.128763:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 45 00000100:00100000:0.0:1788309574.220914:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309574.221050:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192707840 00000100:00100000:1.0:1788309574.221084:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192707840 00000100:00100000:1.0:1788309574.221167:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 163 00000100:00100000:1.0:1788309574.221181:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ec975500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+51:11473:x1875178192707840:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:1.0:1788309574.221227:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788309574.221259:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f462916e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ac46 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788309574.221636:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1788309574.221814:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f462916e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac46 expref: 53 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309574.221833:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c8d83f4800) 00010000:00010000:1.0:1788309574.221836:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788309574.221842:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f462916e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac46 expref: 53 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309574.221860:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8f5548e00, rc 0) 00000100:00100000:1.0:1788309574.221953:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ec975500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+52:11473:x1875178192707840:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 774us (1054us total) trans 4294967451 rc 301/301 00000100:00100000:1.0:1788309574.221962:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 163 00000100:00100000:3.0:1788309574.226618:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309574.226717:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192707968 00000100:00100000:0.0:1788309574.226731:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192707968 00000100:00100000:0.0:1788309574.226815:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 164 00000100:00100000:0.0:1788309574.226828:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffbb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+52:11473:x1875178192707968:12345-192.168.202.55@tcp:34:lfs.0 00010000:00010000:0.0:1788309574.226935:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f400/0x63a04852f462917c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.226959:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f400/0x63a04852f462917c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.226973:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f400/0x63a04852f462917c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.226993:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f4629183 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.227011:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f4629183 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.227017:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f4629183 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.227153:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e800/0x63a04852f462918a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.227162:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e800/0x63a04852f462918a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.227169:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e800/0x63a04852f462918a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788309574.227779:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e800/0x63a04852f462918a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.227801:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f400/0x63a04852f462917c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.227807:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f400/0x63a04852f462917c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.227814:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f400/0x63a04852f462917c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.227821:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8ecf2f400 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:0.0:1788309574.227826:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f400/0x63a04852f462917c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.227833:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f400/0x63a04852f462917c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.227848:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97c8d832f200) 00010000:00010000:0.0:1788309574.227851:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788309574.227857:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f400/0x63a04852f462917c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.227863:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f400/0x63a04852f462917c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.227885:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f4629183 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.227892:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f4629183 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.227907:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f4629183 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.227912:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8ecf2ec00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:0.0:1788309574.227915:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f4629183 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.227922:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f4629183 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.227930:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97c8c2ab9000) 00010000:00010000:0.0:1788309574.227932:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788309574.227936:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f4629183 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.227941:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f4629183 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.227959:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e800/0x63a04852f462918a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.227966:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e800/0x63a04852f462918a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.227972:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e800/0x63a04852f462918a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.227976:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8ecf2e800 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:0.0:1788309574.227978:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e800/0x63a04852f462918a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.227992:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e800/0x63a04852f462918a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.228011:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c8c2ab9700) 00010000:00010000:0.0:1788309574.228013:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788309574.228016:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e800/0x63a04852f462918a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.228022:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e800/0x63a04852f462918a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309574.228260:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffbb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+52:11473:x1875178192707968:12345-192.168.202.55@tcp:34:lfs.0 Request processed in 1429us (1652us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309574.228273:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 164 00000100:00100000:2.0:1788309574.245244:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309574.246996:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192708224 00000100:00100000:1.0:1788309574.247028:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192708224 00000100:00100000:1.0:1788309574.247115:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 46 00000100:00100000:1.0:1788309574.247128:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8edf33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+52:11473:x1875178192708224:12345-192.168.202.55@tcp:35:lfs.0 00000100:00100000:1.0:1788309574.247649:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8edf33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+53:11473:x1875178192708224:12345-192.168.202.55@tcp:35:lfs.0 Request processed in 520us (2418us total) trans 4294967452 rc 0/0 00000100:00100000:1.0:1788309574.247661:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 46 00000100:00100000:1.0:1788309574.313830:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309574.314024:0:8305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192708480 00000100:00100000:0.0:1788309574.314038:0:8305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192708480 00000100:00100000:0.0:1788309574.314116:0:8305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 165 00000100:00100000:0.0:1788309574.314129:0:8305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f52aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+53:11476:x1875178192708480:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:0.0:1788309574.314173:0:8305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788309574.314203:0:8305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e800/0x63a04852f4629191 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ac4d expref: -99 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.314377:0:8305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f4629198 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.314395:0:8305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f4629198 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.314424:0:8305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f4629198 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.314463:0:8305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f400/0x63a04852f462919f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.314471:0:8305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f400/0x63a04852f462919f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.314776:0:8305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f400/0x63a04852f462919f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.314962:0:8305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ee00/0x63a04852f46291a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.314971:0:8305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ee00/0x63a04852f46291a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.314979:0:8305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ee00/0x63a04852f46291a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788309574.314990:0:8305:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788309574.315149:0:8305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f4629198 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.315157:0:8305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f4629198 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.315165:0:8305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f4629198 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.315173:0:8305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8ecf2ec00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:0.0:1788309574.315179:0:8305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f4629198 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.315203:0:8305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f4629198 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.315231:0:8305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97c8d832f200) 00010000:00010000:0.0:1788309574.315234:0:8305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788309574.315239:0:8305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f4629198 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.315245:0:8305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f4629198 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.315264:0:8305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f400/0x63a04852f462919f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.315269:0:8305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f400/0x63a04852f462919f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.315275:0:8305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f400/0x63a04852f462919f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.315350:0:8305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8ecf2f400 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:0.0:1788309574.315353:0:8305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f400/0x63a04852f462919f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.315358:0:8305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f400/0x63a04852f462919f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.315365:0:8305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97c8c2ab9000) 00010000:00010000:0.0:1788309574.315368:0:8305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788309574.315371:0:8305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f400/0x63a04852f462919f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.315388:0:8305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f400/0x63a04852f462919f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.318839:0:8305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e800/0x63a04852f4629191 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac4d expref: 56 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.318888:0:8305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ee00/0x63a04852f46291a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac4d expref: 55 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.318902:0:8305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c8c2ab9700) 00010000:00010000:0.0:1788309574.318907:0:8305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788309574.318912:0:8305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8ecf2ee00, rc 0) 00000100:00100000:0.0:1788309574.319274:0:8305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f52aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+55:11476:x1875178192708480:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 5145us (5457us total) trans 4294967453 rc 0/0 00000100:00100000:0.0:1788309574.321954:0:8305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 165 00000100:00100000:3.0:1788309574.329110:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309574.331604:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192708608 00000100:00100000:0.0:1788309574.331623:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192708608 00000100:00100000:0.0:1788309574.331722:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 166 00000100:00100000:0.0:1788309574.331734:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffbb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+55:11476:x1875178192708608:12345-192.168.202.55@tcp:54:lfs.0 00010000:00010000:0.0:1788309574.331853:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f46291b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.331879:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f46291b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.331894:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f46291b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.331960:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f46291b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.331969:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f46291b4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.331977:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f46291b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.331983:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8ecf2ec00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:0.0:1788309574.331989:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f46291b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.331998:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f46291b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.332014:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c8c2ab9700) 00010000:00010000:0.0:1788309574.332017:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788309574.332023:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f46291b4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.332029:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f46291b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309574.332140:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffbb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+55:11476:x1875178192708608:12345-192.168.202.55@tcp:54:lfs.0 Request processed in 407us (3044us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309574.332148:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 166 00000100:00100000:2.0:1788309574.337214:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309574.338768:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192708736 00000100:00100000:0.0:1788309574.338793:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192708736 00000100:00100000:0.0:1788309574.338915:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 13 00000100:00100000:0.0:1788309574.338954:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8edf32d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+55:2351:x1875178192708736:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788309574.338979:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788309574.339272:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ee00/0x63a04852f46291a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac4d expref: 55 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.339401:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c8c2ab9700) 00010000:00010000:0.0:1788309574.339467:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788309574.339805:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8edf32d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+54:2351:x1875178192708736:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 852us (2614us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309574.339815:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 13 00000100:00100000:1.0:1788309574.347338:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309574.347630:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192708992 00000100:00100000:0.0:1788309574.347644:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192708992 00000100:00100000:0.0:1788309574.347725:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 47 00000100:00100000:0.0:1788309574.347739:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f52ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+54:11476:x1875178192708992:12345-192.168.202.55@tcp:35:lfs.0 00000100:00100000:0.0:1788309574.348095:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f52ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+55:11476:x1875178192708992:12345-192.168.202.55@tcp:35:lfs.0 Request processed in 357us (820us total) trans 4294967454 rc 0/0 00000100:00100000:0.0:1788309574.348105:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 47 00010000:00010000:3.0:1788309574.373578:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788309574.603188:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309574.603249:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309574.603327:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309574.603365:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309574.603511:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192709248 00000100:00100000:1.0:1788309574.603520:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192709248 00000100:00100000:1.0:1788309574.603605:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192709376 00000100:00100000:1.0:1788309574.603608:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192709376 00000100:00100000:1.0:1788309574.603637:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 88 00000100:00100000:1.0:1788309574.603646:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffbb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+7:2351:x1875178192709248:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788309574.603718:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffbb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+7:2351:x1875178192709248:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 72us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309574.603726:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 88 00000100:00100000:1.0:1788309574.603745:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 89 00000100:00100000:1.0:1788309574.603752:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffbb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:2351:x1875178192709376:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788309574.603789:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffbb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:2351:x1875178192709376:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 27us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309574.603802:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 89 00000100:00100000:1.0:1788309574.603830:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192709504 00000100:00100000:1.0:1788309574.603833:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192709504 00000100:00100000:1.0:1788309574.603863:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 150 00000100:00100000:1.0:1788309574.603869:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffbb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ea7f0717-c12d-4408-bdfd-5a035f695b73+5:2351:x1875178192709504:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788309574.603897:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffbb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ea7f0717-c12d-4408-bdfd-5a035f695b73+5:2351:x1875178192709504:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 29us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309574.603904:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 150 00000100:00100000:2.0:1788309574.604141:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192709120 00000100:00100000:2.0:1788309574.604147:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192709120 00000100:00100000:2.0:1788309574.604184:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 296 00000100:00100000:2.0:1788309574.604192:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6a6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8351692-8d1a-4b41-bdaf-bf179786ff59+13:2351:x1875178192709120:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:2.0:1788309574.604236:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6a6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8351692-8d1a-4b41-bdaf-bf179786ff59+13:2351:x1875178192709120:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 45us (908us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309574.604243:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 296 00000100:00080000:3.0:1788309574.604440:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788309574.604444:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788309574.604446:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788309574.629429:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788309574.629453:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ec976a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210534784:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788309574.629522:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309574.629611:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210534784 00000100:00100000:0.0:1788309574.629620:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210534784 00000100:00100000:0.0:1788309574.629666:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788309574.629675:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ec977800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875178210534784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788309574.629710:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788309574.629769:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ec977800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875178210534784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309574.629804:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788309574.629861:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ec976a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210534784:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788309574.662961:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309574.663046:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192709760 00000100:00100000:1.0:1788309574.663056:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192709760 00000100:00100000:1.0:1788309574.663130:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 167 00000100:00100000:1.0:1788309574.663158:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffbb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+55:11494:x1875178192709760:12345-192.168.202.55@tcp:101:cat.0 00010000:00010000:1.0:1788309574.663185:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788309574.663219:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f46291bb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ac54 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309574.663359:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f46291c2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309574.663374:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f46291c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309574.663386:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f46291c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788309574.663397:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788309574.663533:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f46291bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac54 expref: 58 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309574.663553:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f46291c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac54 expref: 57 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309574.663562:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c8c2ab9700) 00010000:00010000:1.0:1788309574.663565:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788309574.663568:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8f5548000, rc 0) 00000100:00100000:1.0:1788309574.663629:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffbb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+57:11494:x1875178192709760:12345-192.168.202.55@tcp:101:cat.0 Request processed in 474us (680us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1788309574.663636:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 167 00000100:00100000:1.0:1788309574.715948:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309574.716065:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192709888 00000100:00100000:2.0:1788309574.716076:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192709888 00000100:00100000:2.0:1788309574.716136:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 168 00000100:00100000:2.0:1788309574.716148:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f5240a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+57:11495:x1875178192709888:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:2.0:1788309574.716171:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309574.716193:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9600/0x63a04852f46291d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ac5b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309574.716299:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f46291d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309574.716314:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f46291d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309574.716341:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f46291d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788309574.716400:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1788309574.716405:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1788309574.716427:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f46291d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309574.716455:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9600/0x63a04852f46291d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac5b expref: 59 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309574.716474:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f46291d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac5b expref: 58 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309574.716483:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97c8d832f200) 00010000:00010000:2.0:1788309574.716487:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788309574.716490:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8e26d9c00, rc 0) 00000100:00100000:2.0:1788309574.716565:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f5240a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+58:11495:x1875178192709888:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 410us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309574.716573:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 168 00000001:00080000:1.0:1788309574.725441:0:6706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000001:00080000:1.0:1788309574.725478:0:6706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000100:00100000:1.0:1788309574.729313:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309574.729568:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192710272 00000100:00100000:2.0:1788309574.729589:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192710272 00000100:00100000:2.0:1788309574.729650:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 48 00000100:00100000:2.0:1788309574.729662:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f5243480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+58:11495:x1875178192710272:12345-192.168.202.55@tcp:35:lfs.0 00000100:00100000:2.0:1788309574.730222:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f5243480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+59:11495:x1875178192710272:12345-192.168.202.55@tcp:35:lfs.0 Request processed in 560us (918us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1788309574.730231:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 48 00000100:00100000:1.0:1788309574.744781:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309574.744920:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192710400 00000100:00100000:0.0:1788309574.744931:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192710400 00000100:00100000:0.0:1788309574.745005:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 14 00000100:00100000:0.0:1788309574.745017:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f5240700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+59:11495:x1875178192710400:12345-192.168.202.55@tcp:103:lfs.0 00010000:00010000:0.0:1788309574.745032:0:8447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788309574.745058:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f800/0x63a04852f4629167 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac3f expref: 59 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.745082:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f46291c2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac54 expref: 58 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.745094:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e400/0x63a04852f4629072 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac00 expref: 57 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.745105:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c8c2ab9700) 00010000:00010000:0.0:1788309574.745115:0:8447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788309574.745177:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f5240700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+56:11495:x1875178192710400:12345-192.168.202.55@tcp:103:lfs.0 Request processed in 162us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309574.745186:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 14 00000100:00100000:0.0:1788309574.748609:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309574.748727:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192710528 00000100:00100000:1.0:1788309574.748737:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192710528 00000100:00100000:1.0:1788309574.748903:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 169 00000100:00100000:1.0:1788309574.748916:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ec976a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+56:11495:x1875178192710528:12345-192.168.202.55@tcp:58:lfs.0 00010000:00010000:1.0:1788309574.749029:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f46291de lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309574.749046:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f46291de lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309574.749057:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f46291de lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788309574.749272:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:1.0:1788309574.749395:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ec976a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+56:11495:x1875178192710528:12345-192.168.202.55@tcp:58:lfs.0 Request processed in 480us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309574.750093:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 169 00000100:00100000:1.0:1788309574.777032:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309574.777133:0:8305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192710656 00000100:00100000:0.0:1788309574.777143:0:8305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192710656 00000100:00100000:0.0:1788309574.777235:0:8305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 170 00000100:00100000:0.0:1788309574.777247:0:8305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f524ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+56:11497:x1875178192710656:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:0.0:1788309574.777314:0:8305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788309574.777339:0:8305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e400/0x63a04852f46291e5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ac62 expref: -99 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.777413:0:8305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f800/0x63a04852f46291ec lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.777428:0:8305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f800/0x63a04852f46291ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.777440:0:8305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f800/0x63a04852f46291ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.777455:0:8305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f46291f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.777461:0:8305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f46291f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.777467:0:8305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f46291f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.777593:0:8305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e800/0x63a04852f46291fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.777602:0:8305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e800/0x63a04852f46291fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.777608:0:8305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e800/0x63a04852f46291fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788309574.777649:0:8305:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788309574.777661:0:8305:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788309574.777685:0:8305:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e800/0x63a04852f46291fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.777700:0:8305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e800/0x63a04852f46291fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.777708:0:8305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f800/0x63a04852f46291ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.777714:0:8305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f800/0x63a04852f46291ec lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.777720:0:8305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f800/0x63a04852f46291ec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.777726:0:8305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8ecf2f800 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:0.0:1788309574.777730:0:8305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f800/0x63a04852f46291ec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.777738:0:8305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f800/0x63a04852f46291ec lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.777750:0:8305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97c8d832f200) 00010000:00010000:0.0:1788309574.777753:0:8305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788309574.777758:0:8305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f800/0x63a04852f46291ec lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.777764:0:8305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f800/0x63a04852f46291ec lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.777781:0:8305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f46291f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.777930:0:8305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f46291f3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.777937:0:8305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f46291f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.777941:0:8305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8ecf2ec00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:0.0:1788309574.777944:0:8305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f46291f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.777951:0:8305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f46291f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.777959:0:8305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97c8c2ab9700) 00010000:00010000:0.0:1788309574.777962:0:8305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788309574.777964:0:8305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f46291f3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.777969:0:8305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f46291f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.778003:0:8305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e400/0x63a04852f46291e5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac62 expref: 58 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.778015:0:8305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e800/0x63a04852f46291fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac62 expref: 57 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309574.778022:0:8305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c8d832f100) 00010000:00010000:0.0:1788309574.778025:0:8305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788309574.778034:0:8305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8ecf2e800, rc 0) 00000100:00100000:0.0:1788309574.778104:0:8305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f524ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+57:11497:x1875178192710656:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 859us (1082us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309574.778111:0:8305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 170 00000100:00100000:0.0:1788309575.137477:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8f524f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210534912:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788309575.137583:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788309575.137695:0:6902:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 337888416387ns, next at 338888413201ns, rc = 0 00000100:00100000:2.0:1788309575.140246:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210534912 00000100:00100000:2.0:1788309575.140268:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210534912 00000100:00100000:2.0:1788309575.140391:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788309575.140406:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f4c9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875178210534912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788309575.140463:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000040:00080000:1.0:1788309575.140800:0:11678:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788309575.140806:0:11678:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788309575.140851:0:11678:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1788309575.140860:0:11678:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788309575.141033:0:11678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8f524e680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11678:1875178210535040:192.168.202.55@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788309575.141133:0:11678:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c8b5e000 going to sleep for 11 seconds 00000100:00100000:1.0:1788309575.146390:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309575.146453:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192710784 00000100:00100000:1.0:1788309575.146465:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192710784 00000100:00100000:1.0:1788309575.146542:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 171 00000100:00100000:1.0:1788309575.146564:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f524fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+58:11508:x1875178192710784:12345-192.168.202.55@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788309575.146606:0:5838:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788309575.146737:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f524fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+58:11508:x1875178192710784:12345-192.168.202.55@tcp:53:lhsmtool_posix.0 Request processed in 185us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309575.146746:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 171 00000100:00080000:1.0:1788309575.146773:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788309575.146889:0:11678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8f524e680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11678:1875178210535040:192.168.202.55@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788309575.150754:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f4c9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875178210534912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 10334us (13154us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309575.150774:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788309575.155151:0:3301:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:0.0:1788309575.155168:0:3301:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:0.0:1788309575.155233:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8f524f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210534912:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788309575.162258:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309575.162520:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192710912 00000100:00100000:2.0:1788309575.162534:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192710912 00000100:00100000:2.0:1788309575.162612:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 172 00000100:00100000:2.0:1788309575.162626:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f524e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+57:11508:x1875178192710912:12345-192.168.202.55@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788309575.162731:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4629201 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.162751:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4629201 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.162766:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4629201 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.162785:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4629208 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.162792:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4629208 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.162799:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4629208 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.162856:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f462920f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.162866:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f462920f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.162873:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f462920f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788309575.162921:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788309575.162926:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788309575.162940:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f462920f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.162953:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4629201 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.162960:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4629201 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.162968:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4629201 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.162975:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d9a00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309575.162980:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4629201 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.162989:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4629201 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.163143:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97c8c2ab9600) 00010000:00010000:2.0:1788309575.163153:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788309575.163159:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4629201 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.163167:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4629201 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.163184:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4629208 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.163189:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4629208 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.163195:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4629208 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.163209:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d8c00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309575.163212:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4629208 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.163218:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4629208 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.163226:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff97c8d83f4500) 00010000:00010000:2.0:1788309575.163228:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788309575.163231:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4629208 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.163235:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4629208 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.163252:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f462920f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.163266:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f462920f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.163271:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f462920f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.163386:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d8600 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309575.163390:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f462920f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.163396:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f462920f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.163404:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c8d832f100) 00010000:00010000:2.0:1788309575.163406:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788309575.163410:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f462920f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.163416:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f462920f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309575.163525:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f524e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+57:11508:x1875178192710912:12345-192.168.202.55@tcp:34:lhsmtool_posix.0 Request processed in 900us (1280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309575.163535:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 172 00000100:00100000:1.0:1788309575.172705:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309575.173214:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192711168 00000100:00100000:0.0:1788309575.173229:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192711168 00000100:00100000:0.0:1788309575.173349:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 173 00000100:00100000:0.0:1788309575.173365:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f524f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+57:11508:x1875178192711168:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788309575.173394:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788309575.173423:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e400/0x63a04852f4629216 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ac69 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309575.173561:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f462921d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309575.173579:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f462921d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309575.173592:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f462921d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788309575.173606:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788309575.173748:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f462921d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309575.173776:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f462921d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309575.173783:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f462921d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309575.173790:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8ecf2ec00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:0.0:1788309575.173796:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f462921d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309575.173805:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f462921d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309575.173820:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c8d832f100) 00010000:00010000:0.0:1788309575.173824:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788309575.173829:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f462921d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309575.173835:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f462921d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309575.173888:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e400/0x63a04852f4629216 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac69 expref: 59 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309575.173899:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97c8c2ab9600) 00010000:00010000:0.0:1788309575.173902:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788309575.173907:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e400/0x63a04852f4629216 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac69 expref: 59 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309575.173918:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8ecf2e400, rc 0) 00000100:00100000:0.0:1788309575.174001:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f524f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+58:11508:x1875178192711168:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 640us (1314us total) trans 4294967457 rc 301/301 00000100:00100000:0.0:1788309575.174010:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 173 00000100:00100000:1.0:1788309575.180182:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309575.180325:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192711296 00000100:00100000:2.0:1788309575.180340:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192711296 00000100:00100000:2.0:1788309575.180423:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 174 00000100:00100000:2.0:1788309575.180437:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffca8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+58:11508:x1875178192711296:12345-192.168.202.55@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788309575.180489:0:5839:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788309575.180649:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffca8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+58:11508:x1875178192711296:12345-192.168.202.55@tcp:53:lhsmtool_posix.0 Request processed in 215us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309575.180658:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 174 00000100:00100000:1.0:1788309575.188565:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309575.191033:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192711552 00000100:00100000:0.0:1788309575.191054:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192711552 00000100:00100000:0.0:1788309575.191135:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 175 00000100:00100000:0.0:1788309575.191149:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffca8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+58:11508:x1875178192711552:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788309575.191178:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788309575.191183:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788309575.191233:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f46291d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac5b expref: 58 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309575.191259:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97c8d832f200) 00010000:00010000:0.0:1788309575.191266:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788309575.191310:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e400/0x63a04852f462922b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ac70 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788309575.191891:0:5838:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:0.0:1788309575.192128:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f4629232 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309575.192147:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f4629232 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309575.192159:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f4629232 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309575.192248:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e400/0x63a04852f462922b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac70 expref: 60 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309575.192324:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f4629232 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac70 expref: 59 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309575.192334:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97c8c2ab9700) 00010000:00010000:0.0:1788309575.192337:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788309575.192340:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8ecf2ec00, rc 0) 00000100:00100000:0.0:1788309575.192455:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffca8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+59:11508:x1875178192711552:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 1307us (3903us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1788309575.192464:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 175 00000100:00100000:1.0:1788309575.200491:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309575.200614:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192711808 00000100:00100000:0.0:1788309575.200628:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192711808 00000100:00100000:0.0:1788309575.200708:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 176 00000100:00100000:0.0:1788309575.200721:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecdad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+59:11508:x1875178192711808:12345-192.168.202.55@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788309575.200831:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788309575.200870:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f4629232 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac70 expref: 59 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309575.200897:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97c8c2ab9700) 00010000:00010000:0.0:1788309575.200909:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788309575.200938:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f400/0x63a04852f4629240 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309575.200954:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f400/0x63a04852f4629240 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309575.200967:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f400/0x63a04852f4629240 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309575.202951:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549000/0x63a04852f4629247 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x5ab56480 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309575.202978:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549000/0x63a04852f4629247 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x5ab56480 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309575.203000:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549000/0x63a04852f4629247 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x5ab56480 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309575.203107:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f400/0x63a04852f4629240 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309575.203116:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f400/0x63a04852f4629240 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309575.203143:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f400/0x63a04852f4629240 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309575.203150:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8ecf2f400 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:1.0:1788309575.203155:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f400/0x63a04852f4629240 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309575.203165:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f400/0x63a04852f4629240 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309575.203180:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97c8d832f200) 00010000:00010000:1.0:1788309575.203183:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788309575.203189:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f400/0x63a04852f4629240 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309575.203207:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f400/0x63a04852f4629240 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309575.203229:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549000/0x63a04852f4629247 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x5ab56480 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309575.203237:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549000/0x63a04852f4629247 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x5ab56480 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309575.203243:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549000/0x63a04852f4629247 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x5ab56480 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309575.203249:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8f5549000 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:1.0:1788309575.203252:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549000/0x63a04852f4629247 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x5ab56480 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309575.203270:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549000/0x63a04852f4629247 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x5ab56480 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309575.203312:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x5ab56480 (ffff97c8c2ab9000) 00010000:00010000:1.0:1788309575.203492:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788309575.203497:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549000/0x63a04852f4629247 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x5ab56480 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309575.203503:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549000/0x63a04852f4629247 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x5ab56480 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309575.203773:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecdad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+58:11508:x1875178192711808:12345-192.168.202.55@tcp:36:lhsmtool_posix.0 Request processed in 3049us (3291us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788309575.203784:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 176 00000100:00100000:0.0:1788309575.219227:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309575.222732:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192711936 00000100:00100000:3.0:1788309575.222756:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192711936 00000100:00100000:3.0:1788309575.222842:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 177 00000100:00100000:3.0:1788309575.222856:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ec977480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+58:11508:x1875178192711936:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788309575.222887:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309575.222921:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f462924e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ac77 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309575.222988:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4629255 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309575.223007:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4629255 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309575.223022:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4629255 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309575.223150:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f462924e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac77 expref: 60 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309575.223184:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4629255 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac77 expref: 59 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309575.223195:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97c8e2544200) 00010000:00010000:3.0:1788309575.223207:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788309575.223212:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8d73eee00, rc 0) 00000100:00100000:3.0:1788309575.223335:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ec977480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+59:11508:x1875178192711936:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 482us (4122us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309575.223344:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 177 00000100:00100000:0.0:1788309575.234090:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309575.234218:0:8305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192712192 00000100:00100000:1.0:1788309575.234233:0:8305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192712192 00000100:00100000:1.0:1788309575.234640:0:8305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 178 00000100:00100000:1.0:1788309575.234657:0:8305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ec974000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+59:11508:x1875178192712192:12345-192.168.202.55@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788309575.234778:0:8305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549200/0x63a04852f462925c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309575.234801:0:8305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549200/0x63a04852f462925c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309575.234815:0:8305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549200/0x63a04852f462925c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788309575.235175:0:8305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:1.0:1788309575.235188:0:8305:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 337985910227ns, next at 338985907168ns, rc = 0 00000004:00010000:1.0:1788309575.238045:0:8305:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d7629fe5 reply state 00000000eef1b842 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549200/0x63a04852f462925c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309575.238074:0:8305:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788309575.238264:0:8305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ec974000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+61:11508:x1875178192712192:12345-192.168.202.55@tcp:36:lhsmtool_posix.0 Request processed in 3605us (4181us total) trans 4294967459 rc 0/0 00000100:00100000:1.0:1788309575.238304:0:8305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 178 00000100:00100000:1.0:1788309575.241658:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309575.242134:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192712320 00000100:00100000:2.0:1788309575.242148:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192712320 00000100:00100000:2.0:1788309575.242232:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 179 00000100:00100000:2.0:1788309575.242255:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecdadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+61:11508:x1875178192712320:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788309575.242312:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309575.242351:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4629263 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ac7e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.242436:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4629263 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac7e expref: 62 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.242455:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4629263 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac7e expref: 62 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.242482:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97c8e2544200) 00010000:00010000:2.0:1788309575.242485:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788309575.242490:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8e26d9a00, rc 0) 00000100:00100000:2.0:1788309575.242567:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecdadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+62:11508:x1875178192712320:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 315us (921us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309575.242575:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 179 00010000:00010000:0.0:1788309575.252891:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549200/0x63a04852f462925c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309575.252914:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549200/0x63a04852f462925c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309575.252923:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549200/0x63a04852f462925c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309575.252929:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8f5549200 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:0.0:1788309575.252935:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549200/0x63a04852f462925c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309575.252943:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549200/0x63a04852f462925c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309575.252969:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97c8e2544200) 00010000:00010000:0.0:1788309575.252972:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788309575.252977:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549200/0x63a04852f462925c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309575.252983:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549200/0x63a04852f462925c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309575.253448:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309575.254752:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192712448 00000100:00100000:0.0:1788309575.254771:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192712448 00000100:00100000:0.0:1788309575.254860:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 50 00000100:00100000:0.0:1788309575.254873:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8edf32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:2351:x1875178192712448:12345-192.168.202.55@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788309575.255412:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8edf32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+7:2351:x1875178192712448:12345-192.168.202.55@tcp:2:lhsmtool_posix.0 Request processed in 539us (1966us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1788309575.255421:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 50 00000100:00100000:2.0:1788309575.259835:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309575.259999:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192712704 00000100:00100000:3.0:1788309575.260012:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192712704 00000100:00100000:3.0:1788309575.260082:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 49 00000100:00100000:3.0:1788309575.260095:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8edf33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+61:11508:x1875178192712704:12345-192.168.202.55@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788309575.264260:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8edf33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+62:11508:x1875178192712704:12345-192.168.202.55@tcp:35:lhsmtool_posix.0 Request processed in 4155us (4427us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1788309575.265109:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 49 00000100:00100000:2.0:1788309575.266624:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309575.266718:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192712960 00000100:00100000:0.0:1788309575.266727:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192712960 00000100:00100000:0.0:1788309575.266782:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 180 00000100:00100000:0.0:1788309575.266793:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8edf30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+62:11508:x1875178192712960:12345-192.168.202.55@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788309575.266928:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8edf30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+62:11508:x1875178192712960:12345-192.168.202.55@tcp:57:lhsmtool_posix.0 Request processed in 136us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309575.266936:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 180 00000100:00100000:0.0:1788309575.269620:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309575.269694:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192713088 00000100:00100000:2.0:1788309575.269715:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192713088 00000100:00100000:2.0:1788309575.269762:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 181 00000100:00100000:2.0:1788309575.269773:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ec977800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+62:11508:x1875178192713088:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788309575.269793:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309575.269813:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f462926a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ac85 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.269883:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4629271 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.269897:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4629271 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.269910:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4629271 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788309575.269947:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788309575.269965:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4629271 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.269991:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f462926a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac85 expref: 64 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.270008:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4629271 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac85 expref: 63 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.270018:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97c8e2544200) 00010000:00010000:2.0:1788309575.270020:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788309575.270024:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8e26d8600, rc 0) 00000100:00100000:2.0:1788309575.270084:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ec977800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+63:11508:x1875178192713088:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 313us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309575.270098:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 181 00000100:00100000:2.0:1788309575.273797:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309575.273885:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192713216 00000100:00100000:3.0:1788309575.273894:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192713216 00000100:00100000:3.0:1788309575.273938:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 51 00000100:00100000:3.0:1788309575.273948:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8edf32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+7:2351:x1875178192713216:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788309575.273964:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309575.273983:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085a45e72/0x63a04852f4629278 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ac8c expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788309575.274009:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a977047, blocks: 0x1 00010000:00010000:3.0:1788309575.274026:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=338s v=(0 0) 00010000:00010000:3.0:1788309575.274030:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788309575.274039:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085a45e72/0x63a04852f4629278 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac8c expref: 8 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309575.274058:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000085a45e72/0x63a04852f4629278 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac8c expref: 8 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309575.274071:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8d73ef200, rc 0) 00000100:00100000:3.0:1788309575.274131:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8edf32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+8:2351:x1875178192713216:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 184us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309575.274139:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 51 00000100:00100000:3.0:1788309575.277069:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309575.277162:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192713472 00000100:00100000:0.0:1788309575.277173:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192713472 00000100:00100000:0.0:1788309575.277246:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 182 00000100:00100000:0.0:1788309575.277257:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffbb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+63:11508:x1875178192713472:12345-192.168.202.55@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788309575.277404:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffbb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+63:11508:x1875178192713472:12345-192.168.202.55@tcp:57:lhsmtool_posix.0 Request processed in 149us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309575.277411:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 182 00000100:00100000:2.0:1788309575.281780:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309575.281911:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192713600 00000100:00100000:1.0:1788309575.281923:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192713600 00000100:00100000:1.0:1788309575.281986:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 52 00000100:00100000:1.0:1788309575.281999:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8edf33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+8:11508:x1875178192713600:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788309575.282016:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788309575.282033:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d471b0bc/0x63a04852f462927f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ac93 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309575.282065:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000085a45e72/0x63a04852f4629278 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac8c expref: 9 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309575.282074:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788309575.282079:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788309575.282085:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d471b0bc/0x63a04852f462927f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac93 expref: 9 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309575.282118:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000085a45e72/0x63a04852f4629278 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac8c expref: 9 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309575.282151:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000085a45e72/0x63a04852f4629278 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac8c expref: 9 pid: 6681 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309575.282166:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecdaf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1875178210535168:192.168.202.55@tcp:104: 00000100:00100000:1.0:1788309575.282330:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c8b5e000 going to sleep for 11 seconds 00000100:00100000:1.0:1788309575.284723:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecdaf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1875178210535168:192.168.202.55@tcp:104: 00010000:00010000:1.0:1788309575.284759:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d471b0bc/0x63a04852f462927f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac93 expref: 9 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309575.284780:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8f5549000, rc 0) 00000100:00100000:1.0:1788309575.284841:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8edf33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+9:11508:x1875178192713600:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 2844us (3069us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309575.284849:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 52 00000100:00100000:3.0:1788309575.286565:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309575.286710:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192713728 00000100:00100000:1.0:1788309575.286719:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192713728 00010000:00010000:1.0:1788309575.286756:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000085a45e72/0x63a04852f4629278 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac8c expref: 9 pid: 6681 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309575.286784:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 67 00000100:00100000:1.0:1788309575.286793:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffbb1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+9:2350:x1875178192713728:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788309575.286807:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788309575.286829:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000085a45e72/0x63a04852f4629278 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac8c expref: 9 pid: 6681 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309575.286857:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000085a45e72/0x63a04852f4629278 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac8c expref: 9 pid: 6681 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309575.286881:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085a45e72/0x63a04852f4629278 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac8c expref: 9 pid: 6681 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309575.286897:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788309575.286901:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788309575.286911:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d471b0bc/0x63a04852f462927f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac93 expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309575.286921:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d471b0bc/0x63a04852f462927f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac93 expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309575.286953:0:5822:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d471b0bc/0x63a04852f462927f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac93 expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309575.286966:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecdaf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5822:1875178210535296:192.168.202.55@tcp:105: 00000100:00100000:1.0:1788309575.287037:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c8b5e000 going to sleep for 11 seconds 00000100:00100000:1.0:1788309575.290848:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecdaf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5822:1875178210535296:192.168.202.55@tcp:105: 00010000:00010000:1.0:1788309575.290876:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788309575.290934:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffbb1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+8:2350:x1875178192713728:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 4141us (4384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309575.290945:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 67 00000100:00100000:2.0:1788309575.292681:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309575.292822:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192713856 00000100:00100000:1.0:1788309575.292832:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192713856 00002000:00100000:1.0:1788309575.292882:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff97c8edf31180 x1875178192713856/t0(0) o4->86451057-f8bb-4d7c-a7c2-5c834b43e3d3@192.168.202.55@tcp:731/0 lens 504/0 e 0 to 0 dl 1788309586 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788309575.292894:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97c8edf31180 with x1875178192713856 ext(0->8) 00002000:00010000:1.0:1788309575.292900:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97c8edf31180 00000100:00100000:1.0:1788309575.292931:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 4 00000100:00100000:1.0:1788309575.292943:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8edf31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+8:2351:x1875178192713856:12345-192.168.202.55@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788309575.293442:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8edf31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+10:2351:x1875178192713856:12345-192.168.202.55@tcp:4:lhsmtool_posix.0 Request processed in 499us (766us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1788309575.293451:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 4 00002000:00100000:1.0:1788309575.293458:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff97c8edf31180 x1875178192713856/t4294967314(0) o4->86451057-f8bb-4d7c-a7c2-5c834b43e3d3@192.168.202.55@tcp:731/0 lens 504/448 e 0 to 0 dl 1788309586 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788309575.293466:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97c8edf31180 with x1875178192713856 ext(0->8) 00002000:00010000:1.0:1788309575.293470:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97c8edf31180 00000100:00100000:3.0:1788309575.295665:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309575.295826:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192713984 00000100:00100000:2.0:1788309575.295834:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192713984 00000100:00100000:2.0:1788309575.295883:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 183 00000100:00100000:2.0:1788309575.295892:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffbb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+63:11508:x1875178192713984:12345-192.168.202.55@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1788309575.381228:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffbb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+63:11508:x1875178192713984:12345-192.168.202.55@tcp:44:lhsmtool_posix.0 Request processed in 85325us (85559us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309575.381243:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 183 00000001:00080000:1.0:1788309575.381299:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967458 is committed 00000004:00080000:1.0:1788309575.382049:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:1.0:1788309575.382073:0:5859:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff97c8e0686780 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1788309575.382078:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97c8e6543000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff97c8e0686c00 00000020:00080000:1.0:1788309575.382081:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97c8e6543a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff97c8d697fc00 00000001:00080000:1.0:1788309575.382096:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:1.0:1788309575.382106:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000004:00080000:1.0:1788309575.382119:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000001:00080000:1.0:1788309575.382158:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000020:00080000:1.0:1788309575.385539:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:1.0:1788309575.385764:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1788309575.386141:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecdaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210535552:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788309575.386980:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8edf30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875178210535424:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788309575.387027:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309575.387103:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210535424 00000100:00100000:3.0:1788309575.387111:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210535424 00000100:00100000:3.0:1788309575.387155:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788309575.387165:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffbb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875178210535424:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788309575.387193:0:6681:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:3.0:1788309575.387238:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a977044, atime: 0x6a977044, ctime: 0x6a977044, blocks: 0xb 00010000:00010000:3.0:1788309575.387247:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ff3ebed/0x63a04852f4629286 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309575.387265:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=338s v=(0 0) 00010000:00010000:3.0:1788309575.387269:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788309575.387296:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ff3ebed/0x63a04852f4629286 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309575.389245:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309575.389668:0:10673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192714112 00000100:00100000:2.0:1788309575.389678:0:10673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192714112 00000100:00100000:2.0:1788309575.389726:0:10673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 54 00000100:00100000:2.0:1788309575.389736:0:10673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8edf31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+10:2352:x1875178192714112:12345-192.168.202.55@tcp:16:lhsmtool_posix.0 00010000:00010000:3.0:1788309575.389994:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ff3ebed/0x63a04852f4629286 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309575.390011:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ff3ebed/0x63a04852f4629286 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309575.390019:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004ff3ebed/0x63a04852f4629286 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309575.390044:0:6681:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788309575.390541:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309575.390692:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1788309575.390701:0:6682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:0.0:1788309575.392668:0:6680:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1788309575.392684:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210535552 00000100:00100000:0.0:1788309575.392693:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210535552 00000100:00100000:3.0:1788309575.393571:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffbb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3302:x1875178210535424:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6401us (6537us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788309575.393589:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788309575.393997:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788309575.394008:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6815f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210535552:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1788309575.394169:0:6681:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788309575.394173:0:6681:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788309575 00002000:00010000:3.0:1788309575.394176:0:6681:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788309575.394178:0:6681:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788309575 -> 1788309575 00002000:00010000:3.0:1788309575.394180:0:6681:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:2.0:1788309575.394697:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788309575.394708:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004ff3ebed/0x63a04852f4629286 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.394720:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8d73ef800 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:2.0:1788309575.394725:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004ff3ebed/0x63a04852f4629286 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.394736:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004ff3ebed/0x63a04852f4629286 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.394757:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004ff3ebed/0x63a04852f4629286 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.394773:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ff3ebed/0x63a04852f4629286 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.394792:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309575.394794:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309575.394795:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309575.395696:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788309575.397621:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6815f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1875178210535552:12345-0@lo:2:osp-syn-1-0.0 Request processed in 3609us (7074us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1788309575.397634:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000004:00080000:2.0:1788309575.398495:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97c8ecdaf480/2, rc 0, transno 4294967315 00000100:00100000:2.0:1788309575.398505:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecdaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210535552:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1788309575.402621:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97c8edf30700/2, rc 0, transno 4294967307 00000100:00100000:0.0:1788309575.402637:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8edf30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875178210535424:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788309575.446459:0:10673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8edf31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+10:2352:x1875178192714112:12345-192.168.202.55@tcp:16:lhsmtool_posix.0 Request processed in 56715us (57208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309575.446473:0:10673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 54 00000001:00080000:2.0:1788309575.451482:0:7639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:2.0:1788309575.451504:0:7639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:1.0:1788309575.455559:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309575.456045:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192714368 00000100:00100000:3.0:1788309575.456055:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192714368 00000100:00100000:3.0:1788309575.456114:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 184 00000100:00100000:3.0:1788309575.456125:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6814a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+18:11508:x1875178192714368:12345-192.168.202.55@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788309575.456182:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788309575.456220:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4629271 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac85 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309575.456240:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97c8e2544200) 00010000:00010000:3.0:1788309575.456245:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788309575.456300:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f462928d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309575.456322:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f462928d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309575.456348:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f462928d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788309575.456844:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000e9cf19a reply state 000000001566e521 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f462928d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309575.456854:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788309575.456953:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6814a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+19:11508:x1875178192714368:12345-192.168.202.55@tcp:36:lhsmtool_posix.0 Request processed in 829us (1409us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1788309575.456960:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 184 00010000:00010000:1.0:1788309575.465880:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f462928d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309575.465896:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f462928d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309575.465904:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f462928d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309575.465911:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8d73ef800 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:1.0:1788309575.465915:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f462928d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309575.465923:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f462928d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309575.465940:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97c8e2544200) 00010000:00010000:1.0:1788309575.465943:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788309575.465947:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f462928d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309575.465973:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f462928d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309575.466916:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309575.467183:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192714496 00000100:00100000:3.0:1788309575.467203:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192714496 00000100:00100000:3.0:1788309575.467255:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 56 00000100:00100000:3.0:1788309575.467265:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6817100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+7:2351:x1875178192714496:12345-192.168.202.55@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788309575.467500:0:6680:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1788309575.467504:0:6680:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1788309575 -> 1788309574 00002000:00010000:3.0:1788309575.467506:0:6680:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788309572 00002000:00010000:3.0:1788309575.467509:0:6680:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788309575 -> 1788309574 00002000:00010000:3.0:1788309575.467511:0:6680:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1788309575.467713:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6817100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+8:2351:x1875178192714496:12345-192.168.202.55@tcp:2:lhsmtool_posix.0 Request processed in 447us (801us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1788309575.467721:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 56 00000100:00100000:3.0:1788309575.470607:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309575.470719:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192714752 00000100:00100000:1.0:1788309575.470728:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192714752 00000100:00100000:1.0:1788309575.470787:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 185 00000100:00100000:1.0:1788309575.470797:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffbb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+18:11508:x1875178192714752:12345-192.168.202.55@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788309575.470867:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4629294 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309575.470884:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4629255 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac77 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309575.470894:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4629294 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309575.470929:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4629255 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac77 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309575.470944:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4629255 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac77 expref: 18 pid: 5838 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309575.470957:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8d6814000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1875178210535680:192.168.202.55@tcp:104: 00000100:00100000:1.0:1788309575.471040:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8e6bc1780 going to sleep for 11 seconds 00000100:00100000:1.0:1788309575.473867:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8d6814000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1875178210535680:192.168.202.55@tcp:104: 00010000:00010000:1.0:1788309575.473896:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4629294 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309575.490876:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309575.490916:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192714880 00000100:00100000:3.0:1788309575.490926:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192714880 00010000:00010000:3.0:1788309575.490974:0:8447:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4629255 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac77 expref: 19 pid: 5838 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309575.491012:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 68 00000100:00100000:3.0:1788309575.491022:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6b2a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+19:2351:x1875178192714880:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788309575.491036:0:8447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788309575.491044:0:8447:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4629255 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac77 expref: 19 pid: 5838 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309575.491058:0:8447:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4629255 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac77 expref: 19 pid: 5838 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309575.491079:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4629255 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac77 expref: 19 pid: 5838 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309575.491096:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97c8e2544200) 00010000:00010000:3.0:1788309575.491101:0:8447:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4629294 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309575.491110:0:8447:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4629294 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309575.491117:0:8447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4629294 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309575.491141:0:8447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788309575.491205:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6b2a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+18:2351:x1875178192714880:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 173us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309575.491214:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 68 00010000:00010000:3.0:1788309575.491375:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4629294 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309575.491384:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4629294 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309575.491412:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4629294 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309575.491419:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4629294 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309575.492441:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4629294 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309575.492453:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8f5548000 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:3.0:1788309575.492458:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4629294 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309575.492467:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4629294 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309575.492480:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97c8e2544200) 00010000:00010000:3.0:1788309575.492483:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788309575.492487:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4629294 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309575.492493:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4629294 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309575.492567:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffbb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+17:11508:x1875178192714752:12345-192.168.202.55@tcp:55:lhsmtool_posix.0 Request processed in 21769us (21966us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788309575.492587:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 185 00000100:00100000:3.0:1788309575.500678:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309575.500752:0:12478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192715008 00000100:00100000:2.0:1788309575.500761:0:12478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192715008 00000100:00100000:2.0:1788309575.500820:0:12478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 57 00000100:00100000:2.0:1788309575.500830:0:12478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffbb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+8:2350:x1875178192715008:12345-192.168.202.55@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788309575.500874:0:12478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008a614ec5/0x63a04852f462929b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.500895:0:12478:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d471b0bc/0x63a04852f462927f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac93 expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.500904:0:12478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788309575.500908:0:12478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788309575.500926:0:12478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a614ec5/0x63a04852f462929b lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.500963:0:12478:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d471b0bc/0x63a04852f462927f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac93 expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.500978:0:12478:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d471b0bc/0x63a04852f462927f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac93 expref: 8 pid: 6682 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309575.500994:0:12478:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8edf31880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12478:1875178210535808:192.168.202.55@tcp:104: 00000100:00100000:2.0:1788309575.501073:0:12478:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8f51d7600 going to sleep for 11 seconds 00000100:00100000:2.0:1788309575.509534:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309575.509580:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192715136 00000100:00100000:2.0:1788309575.509589:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192715136 00010000:00010000:2.0:1788309575.509628:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d471b0bc/0x63a04852f462927f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac93 expref: 9 pid: 6682 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309575.509666:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 69 00000100:00100000:2.0:1788309575.509677:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8edf30a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+9:2350:x1875178192715136:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788309575.509691:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788309575.509715:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d471b0bc/0x63a04852f462927f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac93 expref: 9 pid: 6682 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.509729:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d471b0bc/0x63a04852f462927f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac93 expref: 9 pid: 6682 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.509776:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788309575.509780:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788309575.510032:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008a614ec5/0x63a04852f462929b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 12478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.510045:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a614ec5/0x63a04852f462929b lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 12478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.510067:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788309575.510134:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8edf30a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+9:2350:x1875178192715136:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 458us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309575.510141:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 69 00010000:00010000:3.0:1788309575.511025:0:12478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d471b0bc/0x63a04852f462927f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac93 expref: 8 pid: 6682 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309575.511041:0:12478:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8edf31880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12478:1875178210535808:192.168.202.55@tcp:104: 00010000:00010000:3.0:1788309575.511064:0:12478:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008a614ec5/0x63a04852f462929b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309575.511074:0:12478:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008a614ec5/0x63a04852f462929b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309575.511091:0:12478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a614ec5/0x63a04852f462929b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309575.511118:0:12478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008a614ec5/0x63a04852f462929b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309575.511127:0:12478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008a614ec5/0x63a04852f462929b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309575.511136:0:12478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008a614ec5/0x63a04852f462929b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309575.511143:0:12478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d9c00 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:3.0:1788309575.511156:0:12478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008a614ec5/0x63a04852f462929b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309575.511165:0:12478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008a614ec5/0x63a04852f462929b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309575.511178:0:12478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008a614ec5/0x63a04852f462929b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309575.511186:0:12478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a614ec5/0x63a04852f462929b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309575.511312:0:12478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffbb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+7:2350:x1875178192715008:12345-192.168.202.55@tcp:1:lhsmtool_posix.0 Request processed in 10476us (10639us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309575.511320:0:12478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 57 00000100:00100000:2.0:1788309575.519780:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309575.519927:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192715392 00000100:00100000:3.0:1788309575.519939:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192715392 00000100:00100000:3.0:1788309575.520011:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 186 00000100:00100000:3.0:1788309575.520023:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8edf31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+17:11508:x1875178192715392:12345-192.168.202.55@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788309575.520117:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f46292a2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309575.520135:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f46292a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309575.520147:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f46292a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.520825:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f46292a9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.520839:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4629263 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac7e expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.520848:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f46292a9 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.520883:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4629263 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac7e expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.520898:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4629263 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac7e expref: 18 pid: 5838 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309575.520926:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8edf33b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875178210535936:192.168.202.55@tcp:104: 00000100:00100000:2.0:1788309575.521021:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8f51d7f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788309575.539769:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309575.539825:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192715520 00000100:00100000:3.0:1788309575.539834:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192715520 00010000:00010000:3.0:1788309575.539875:0:8447:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4629263 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac7e expref: 19 pid: 5838 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309575.539910:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 70 00000100:00100000:3.0:1788309575.539921:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffbb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+19:2351:x1875178192715520:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788309575.539937:0:8447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788309575.539945:0:8447:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4629263 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac7e expref: 19 pid: 5838 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309575.539960:0:8447:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4629263 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac7e expref: 19 pid: 5838 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309575.539982:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97c8e2544200) 00010000:00010000:3.0:1788309575.539988:0:8447:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f46292a9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309575.539998:0:8447:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f46292a9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309575.540007:0:8447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f46292a9 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309575.540040:0:8447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788309575.540104:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffbb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+19:2351:x1875178192715520:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 185us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309575.540129:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 70 00010000:00010000:2.0:1788309575.542078:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4629263 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac7e expref: 18 pid: 5838 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309575.542113:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8edf33b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875178210535936:192.168.202.55@tcp:104: 00010000:00010000:2.0:1788309575.542140:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f46292a9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.542151:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f46292a9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.542157:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f46292a9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788309575.542400:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:2.0:1788309575.542925:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:2.0:1788309575.542972:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:2.0:1788309575.543061:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8edf33b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5839:1875178210536064:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788309575.543145:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309575.543183:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8f51d7240 going to sleep for 11 seconds 00000100:00100000:0.0:1788309575.543411:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210536064 00000100:00100000:0.0:1788309575.543420:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210536064 00000100:00100000:0.0:1788309575.543921:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788309575.543931:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8edf31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5839:x1875178210536064:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788309575.544019:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8edf31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5839:x1875178210536064:12345-0@lo:1000:mdt00_002.0 Request processed in 90us (874us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309575.544026:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788309575.545061:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8edf33b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5839:1875178210536064:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1788309575.547002:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:2.0:1788309575.547081:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8edf33b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5839:1875178210536192:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788309575.547155:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309575.547187:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8f51d7f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788309575.550824:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210536192 00000100:00100000:0.0:1788309575.550840:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210536192 00000100:00100000:0.0:1788309575.550911:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788309575.550923:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8edf32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5839:x1875178210536192:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788309575.551235:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8edf32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5839:x1875178210536192:12345-0@lo:1000:mdt00_002.0 Request processed in 314us (4079us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1788309575.551244:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788309575.553299:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8edf33b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5839:1875178210536192:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1788309575.553371:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f46292a9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.553382:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f46292a9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.553391:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f46292a9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.553397:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d9c00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309575.553402:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f46292a9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.553410:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f46292a9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.553439:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97c8e2544200) 00010000:00010000:2.0:1788309575.553443:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788309575.553448:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f46292a9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.553454:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f46292a9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.553490:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f46291de lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.553496:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f46291de lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.553502:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f46291de lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.553520:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8f5548800 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309575.553524:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f46291de lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.553530:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f46291de lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.553539:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c8d832f100) 00010000:00010000:2.0:1788309575.553542:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788309575.553545:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f46291de lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.553855:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f46291de lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.553879:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9600/0x63a04852f46292b0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.553893:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e800/0x63a04852f46291fa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac62 expref: 21 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.553903:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9600/0x63a04852f46292b0 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.553943:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e800/0x63a04852f46291fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac62 expref: 21 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.553960:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e800/0x63a04852f46291fa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac62 expref: 21 pid: 8305 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309575.553990:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8c89f9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875178210536320:192.168.202.55@tcp:104: 00000100:00100000:2.0:1788309575.554098:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8f51d7f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788309575.567812:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309575.567938:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192715648 00000100:00100000:0.0:1788309575.567948:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192715648 00010000:00010000:0.0:1788309575.567988:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e800/0x63a04852f46291fa lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac62 expref: 22 pid: 8305 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309575.568030:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 71 00000100:00100000:0.0:1788309575.568040:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffbb3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+22:2350:x1875178192715648:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788309575.568055:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788309575.568061:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e800/0x63a04852f46291fa lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac62 expref: 22 pid: 8305 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309575.568074:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e800/0x63a04852f46291fa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac62 expref: 22 pid: 8305 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309575.568096:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c8d832f100) 00010000:00010000:0.0:1788309575.568118:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9600/0x63a04852f46292b0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309575.568128:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9600/0x63a04852f46292b0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309575.568136:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9600/0x63a04852f46292b0 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309575.568155:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788309575.568214:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffbb3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+22:2350:x1875178192715648:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 175us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309575.568221:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 71 00010000:00010000:2.0:1788309575.568339:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e800/0x63a04852f46291fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac62 expref: 21 pid: 8305 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309575.568358:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8c89f9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875178210536320:192.168.202.55@tcp:104: 00010000:00010000:2.0:1788309575.568379:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9600/0x63a04852f46292b0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.568388:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9600/0x63a04852f46292b0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.568394:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9600/0x63a04852f46292b0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.568405:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9600/0x63a04852f46292b0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.568410:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9600/0x63a04852f46292b0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.568417:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9600/0x63a04852f46292b0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.568423:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d9600 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309575.568441:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9600/0x63a04852f46292b0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.568449:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9600/0x63a04852f46292b0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.568467:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c8d832f100) 00010000:00010000:2.0:1788309575.568469:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788309575.568482:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9600/0x63a04852f46292b0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.568490:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9600/0x63a04852f46292b0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.568502:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f46292a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.568509:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f46292a2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.568515:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f46292a2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.568519:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8d73eee00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309575.568521:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f46292a2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.568526:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f46292a2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.568534:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c8d832f100) 00010000:00010000:2.0:1788309575.568536:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788309575.568539:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f46292a2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309575.568544:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f46292a2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309575.568775:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8edf31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+20:11508:x1875178192715392:12345-192.168.202.55@tcp:57:lhsmtool_posix.0 Request processed in 48753us (49005us total) trans 4294967466 rc 0/0 00000100:00100000:2.0:1788309575.568796:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 186 00000020:00080000:2.0:1788309575.568801:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788309575.569191:0:11678:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788309575.569208:0:11678:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788309575.569743:0:11678:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1788309575.569754:0:11678:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788309575.579851:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309575.582122:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192715904 00000100:00100000:3.0:1788309575.582137:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192715904 00000100:00100000:3.0:1788309575.582204:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 50 00000100:00100000:3.0:1788309575.582220:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e663a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+20:11508:x1875178192715904:12345-192.168.202.55@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788309575.582926:0:5840:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788309575.583033:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:3.0:1788309575.583079:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f46292b7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309575.583096:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f46292b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309575.583109:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f46292b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309575.583118:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f46292b7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309575.583125:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f46292b7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309575.583131:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f46292b7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309575.583150:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788309575.583259:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e663a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+22:11508:x1875178192715904:12345-192.168.202.55@tcp:35:lhsmtool_posix.0 Request processed in 1043us (3416us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1788309575.583300:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 50 00000020:00080000:3.0:1788309575.583304:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788309575.583354:0:7627:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788309575.583360:0:7627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f46292b7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309575.583367:0:7627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8d73ef200 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:3.0:1788309575.583371:0:7627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f46292b7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309575.583378:0:7627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f46292b7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309575.583390:0:7627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97c8e2544c00) 00010000:00010000:3.0:1788309575.583393:0:7627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788309575.583397:0:7627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f46292b7 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309575.583402:0:7627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f46292b7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309575.583416:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309575.583418:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309575.583419:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788309575.914662:0:12505:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788309575.914670:0:12505:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788309575.914707:0:12505:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1788309575.914713:0:12505:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788309576.131812:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309576.135854:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192716160 00000100:00100000:3.0:1788309576.135871:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192716160 00000100:00100000:3.0:1788309576.135950:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 187 00000100:00100000:3.0:1788309576.135961:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6814000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+22:11518:x1875178192716160:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:3.0:1788309576.135985:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309576.136008:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f46292be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ac9a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.141513:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f46292c5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.141537:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f46292c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.141549:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f46292c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788309576.141565:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1788309576.141789:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f46292be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac9a expref: 25 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.141809:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f46292c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac9a expref: 24 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.141819:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97c8d832f200) 00010000:00010000:3.0:1788309576.141822:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788309576.141826:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8d73ef200, rc 0) 00000100:00100000:3.0:1788309576.141903:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6814000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+24:11518:x1875178192716160:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 5943us (10100us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1788309576.141913:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 187 00000100:00100000:0.0:1788309576.167212:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309576.171559:0:8305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192716288 00000100:00100000:3.0:1788309576.171576:0:8305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192716288 00000100:00100000:3.0:1788309576.171704:0:8305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 188 00000100:00100000:3.0:1788309576.171717:0:8305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e667dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+24:11518:x1875178192716288:12345-192.168.202.55@tcp:34:lfs.0 00010000:00010000:3.0:1788309576.171797:0:8305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f46292d3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.171829:0:8305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f46292d3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.171842:0:8305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f46292d3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.171861:0:8305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f46292da lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.171869:0:8305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f46292da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.171877:0:8305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f46292da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.172179:0:8305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f46292e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.172198:0:8305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f46292e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.172207:0:8305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f46292e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788309576.172243:0:8305:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f46292e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.172255:0:8305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f46292d3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.172262:0:8305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f46292d3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.172301:0:8305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f46292d3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.172307:0:8305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8d73ee400 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:3.0:1788309576.172313:0:8305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f46292d3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.172321:0:8305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f46292d3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.172334:0:8305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97c8d832f200) 00010000:00010000:3.0:1788309576.172337:0:8305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788309576.172341:0:8305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f46292d3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.172347:0:8305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f46292d3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.172359:0:8305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f46292da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.172365:0:8305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f46292da lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.172371:0:8305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f46292da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.172376:0:8305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8d73eee00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:3.0:1788309576.172379:0:8305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f46292da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.172394:0:8305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f46292da lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.172403:0:8305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97c8e2544700) 00010000:00010000:3.0:1788309576.172405:0:8305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788309576.172409:0:8305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f46292da lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.172414:0:8305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f46292da lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.172427:0:8305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f46292e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.172432:0:8305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f46292e1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.172438:0:8305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f46292e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.172443:0:8305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8d73ef800 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:3.0:1788309576.172446:0:8305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f46292e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.172451:0:8305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f46292e1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.172458:0:8305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c8e2544c00) 00010000:00010000:3.0:1788309576.172460:0:8305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788309576.172463:0:8305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f46292e1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.172478:0:8305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f46292e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309576.172607:0:8305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e667dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+24:11518:x1875178192716288:12345-192.168.202.55@tcp:34:lfs.0 Request processed in 891us (5402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309576.172616:0:8305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 188 00000100:00100000:0.0:1788309576.265656:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309576.265794:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192716544 00000100:00100000:2.0:1788309576.265803:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192716544 00000100:00100000:2.0:1788309576.265862:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 189 00000100:00100000:2.0:1788309576.265873:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e667c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+24:11521:x1875178192716544:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:2.0:1788309576.265893:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309576.265916:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f46292e8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146aca1 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309576.265988:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f46292ef lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309576.266004:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f46292ef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309576.266017:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f46292ef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309576.266034:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f46292f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309576.266042:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f46292f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309576.266063:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f46292f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309576.266452:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f46292fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309576.266461:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f46292fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309576.266469:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f46292fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788309576.266478:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1788309576.266581:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f46292ef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309576.266589:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f46292ef lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309576.266596:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f46292ef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309576.266602:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d8c00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309576.266606:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f46292ef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309576.266613:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f46292ef lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309576.266625:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97c8d832f200) 00010000:00010000:2.0:1788309576.266628:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788309576.266640:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f46292ef lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309576.266647:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f46292ef lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309576.266660:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f46292f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309576.266667:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f46292f6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309576.266673:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f46292f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309576.266678:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d9a00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309576.266681:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f46292f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309576.266687:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f46292f6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309576.266694:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97c8d83f4400) 00010000:00010000:2.0:1788309576.266697:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788309576.266700:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f46292f6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309576.266705:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f46292f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309576.266747:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f46292e8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aca1 expref: 27 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309576.266773:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f46292fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aca1 expref: 26 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309576.266780:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c8d83f4c00) 00010000:00010000:2.0:1788309576.266782:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788309576.266785:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8e26d9c00, rc 0) 00000100:00100000:2.0:1788309576.266839:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e667c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+26:11521:x1875178192716544:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 968us (1192us total) trans 4294967470 rc 0/0 00000100:00100000:2.0:1788309576.266846:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 189 00000100:00100000:1.0:1788309576.278150:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309576.278244:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192716672 00000100:00100000:2.0:1788309576.278255:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192716672 00000100:00100000:2.0:1788309576.278364:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 190 00000100:00100000:2.0:1788309576.278375:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8efef8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+26:11521:x1875178192716672:12345-192.168.202.55@tcp:54:lfs.0 00010000:00010000:2.0:1788309576.278442:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f462930b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309576.278458:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f462930b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309576.278470:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f462930b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309576.278499:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f462930b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309576.278505:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f462930b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309576.278529:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f462930b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309576.278535:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d8600 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309576.278540:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f462930b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309576.278548:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f462930b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309576.278560:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c8d83f4c00) 00010000:00010000:2.0:1788309576.278563:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788309576.278568:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f462930b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309576.278573:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f462930b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309576.278642:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8efef8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+26:11521:x1875178192716672:12345-192.168.202.55@tcp:54:lfs.0 Request processed in 268us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309576.278651:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 190 00000100:00100000:0.0:1788309576.280671:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309576.282145:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192716928 00000100:00100000:3.0:1788309576.282156:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192716928 00000100:00100000:2.0:1788309576.282316:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 51 00000100:00100000:2.0:1788309576.282335:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e667f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+26:11521:x1875178192716928:12345-192.168.202.55@tcp:35:lfs.0 00000100:00100000:2.0:1788309576.282577:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e667f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+27:11521:x1875178192716928:12345-192.168.202.55@tcp:35:lfs.0 Request processed in 244us (1911us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1788309576.282585:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 51 00000100:00100000:0.0:1788309576.336841:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309576.336974:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192717184 00000100:00100000:2.0:1788309576.336986:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192717184 00000100:00100000:2.0:1788309576.337062:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 191 00000100:00100000:2.0:1788309576.337072:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e667d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+27:11055:x1875178192717184:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:2.0:1788309576.337097:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309576.337118:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4629312 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146aca8 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309576.337249:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4629319 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309576.337264:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f46292fd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aca1 expref: 28 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309576.337273:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4629319 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309576.337661:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f46292fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aca1 expref: 28 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309576.337676:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f46292fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aca1 expref: 28 pid: 5837 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309576.337690:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8c89f9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1875178210536448:192.168.202.55@tcp:104: 00000100:00100000:2.0:1788309576.337827:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8f51d7cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788309576.345529:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8c89f9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1875178210536448:192.168.202.55@tcp:104: 00010000:00010000:2.0:1788309576.345560:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4629319 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309576.347368:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309576.351794:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192717312 00000100:00100000:3.0:1788309576.351810:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192717312 00010000:00010000:3.0:1788309576.351861:0:8447:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f46292fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aca1 expref: 29 pid: 5837 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309576.351904:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 72 00000100:00100000:3.0:1788309576.351915:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6587100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+29:2350:x1875178192717312:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788309576.351930:0:8447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788309576.351936:0:8447:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f46292fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aca1 expref: 29 pid: 5837 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.351950:0:8447:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f46292fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aca1 expref: 29 pid: 5837 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.351970:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f46292fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aca1 expref: 29 pid: 5837 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.351987:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c8d83f4c00) 00010000:00010000:3.0:1788309576.351991:0:8447:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4629319 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.352014:0:8447:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4629319 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.352021:0:8447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4629319 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.352058:0:8447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788309576.353315:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4629319 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309576.353339:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4629319 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788309576.353362:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1788309576.353526:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4629312 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aca8 expref: 30 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309576.354767:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6587100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+29:2350:x1875178192717312:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 2849us (7401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309576.354778:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 72 00010000:00010000:2.0:1788309576.355931:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4629319 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aca8 expref: 28 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309576.355946:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c8d83f4c00) 00010000:00010000:2.0:1788309576.355949:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788309576.355952:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8e26d9a00, rc 0) 00000100:00100000:2.0:1788309576.356014:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e667d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+28:11055:x1875178192717184:12345-192.168.202.55@tcp:101:bash.0 Request processed in 18942us (19185us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1788309576.356021:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 191 00000100:00100000:2.0:1788309576.358677:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309576.358945:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192717568 00000100:00100000:3.0:1788309576.358953:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192717568 00000100:00100000:3.0:1788309576.359007:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 192 00000100:00100000:3.0:1788309576.359018:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c89f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+28:11055:x1875178192717568:12345-192.168.202.55@tcp:36:bash.0 00010000:00010000:3.0:1788309576.359332:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f4629327 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.359349:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f4629327 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.359360:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f4629327 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788309576.359416:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:3.0:1788309576.359441:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000019d942d2 reply state 000000009ca500f1 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f4629327 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309576.359450:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1788309576.359498:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:3.0:1788309576.360496:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c89f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+32:11055:x1875178192717568:12345-192.168.202.55@tcp:36:bash.0 Request processed in 1476us (1822us total) trans 4294967475 rc 0/0 00000100:00100000:3.0:1788309576.360518:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 192 00000020:00080000:3.0:1788309576.360524:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:2.0:1788309576.372502:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f4629327 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309576.372523:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f4629327 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309576.372533:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f4629327 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309576.372540:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8d73ef800 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309576.372556:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f4629327 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309576.372582:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f4629327 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309576.372601:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c8d83f4c00) 00010000:00010000:2.0:1788309576.372605:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788309576.372610:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f4629327 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309576.372616:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f4629327 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309576.377337:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309576.377449:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192717696 00000100:00100000:3.0:1788309576.377460:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192717696 00000100:00100000:3.0:1788309576.377521:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 193 00000100:00100000:3.0:1788309576.377533:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c89f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+31:11055:x1875178192717696:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:3.0:1788309576.377565:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309576.377588:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f462932e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146acaf expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.377657:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f462932e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146acaf expref: 32 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.377673:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f462932e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146acaf expref: 32 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.377695:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c8d83f4c00) 00010000:00010000:3.0:1788309576.377699:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788309576.377703:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8d73eee00, rc 0) 00000100:00100000:3.0:1788309576.377757:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c89f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+32:11055:x1875178192717696:12345-192.168.202.55@tcp:101:bash.0 Request processed in 226us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309576.377765:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 193 00000100:00100000:3.0:1788309576.381088:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309576.381171:0:10673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192717824 00000100:00100000:2.0:1788309576.381180:0:10673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192717824 00000100:00100000:2.0:1788309576.381251:0:10673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 58 00000100:00100000:2.0:1788309576.381262:0:10673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffbb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+7:11055:x1875178192717824:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:2.0:1788309576.381313:0:10673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309576.381481:0:10673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bda9db79/0x63a04852f4629335 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146acb6 expref: -99 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788309576.381510:0:10673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a977046, atime: 0x6a977044, ctime: 0x6a977046, blocks: 0xb 00010000:00010000:2.0:1788309576.381531:0:10673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=339s v=(0 0) 00010000:00010000:2.0:1788309576.381536:0:10673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788309576.381555:0:10673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bda9db79/0x63a04852f4629335 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146acb6 expref: 8 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309576.381574:0:10673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bda9db79/0x63a04852f4629335 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146acb6 expref: 8 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309576.381602:0:10673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8e26d8600, rc 0) 00000100:00080000:1.0:1788309576.381621:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788309576.381704:0:10673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffbb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+8:11055:x1875178192717824:12345-192.168.202.55@tcp:101:bash.0 Request processed in 443us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309576.381712:0:10673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 58 00000100:00100000:0.0:1788309576.390139:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309576.390246:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192717952 00000100:00100000:2.0:1788309576.390256:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192717952 00002000:00010000:2.0:1788309576.390861:0:6687:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:2.0:1788309576.390867:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97c8e6585500 with x1875178192717952 ext(0->18446744073709551615) 00002000:00010000:2.0:1788309576.390879:0:6687:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97c8e6585500. 00000100:00100000:2.0:1788309576.390964:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 5 00000100:00100000:2.0:1788309576.390977:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6585500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+8:2350:x1875178192717952:12345-192.168.202.55@tcp:10:bash.0 00002000:00010000:2.0:1788309576.391273:0:6687:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1788309576.391309:0:6687:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1788309574 -> 1788309576 00002000:00010000:2.0:1788309576.391312:0:6687:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1788309572 -> 1788309572 00002000:00010000:2.0:1788309576.391315:0:6687:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788309574 -> 1788309576 00002000:00010000:2.0:1788309576.391318:0:6687:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1788309576.391559:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6585500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+9:2350:x1875178192717952:12345-192.168.202.55@tcp:10:bash.0 Request processed in 583us (1429us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1788309576.391567:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 5 00002000:00010000:2.0:1788309576.391571:0:6687:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:2.0:1788309576.391574:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97c8e6585500 with x1875178192717952 ext(0->18446744073709551615) 00002000:00010000:2.0:1788309576.391579:0:6687:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97c8e6585500. 00010000:00010000:3.0:1788309576.423961:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788309576.506803:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309576.506899:0:8305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192718080 00000100:00100000:3.0:1788309576.506909:0:8305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192718080 00000100:00100000:3.0:1788309576.506973:0:8305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 194 00000100:00100000:3.0:1788309576.506992:0:8305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6585f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+32:11535:x1875178192718080:12345-192.168.202.55@tcp:34:lfs.0 00010000:00010000:3.0:1788309576.507066:0:8305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f462933c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.507083:0:8305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f462933c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.507095:0:8305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f462933c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.507112:0:8305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f4629343 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.507119:0:8305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f4629343 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.507126:0:8305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f4629343 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.507493:0:8305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f462934a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.507504:0:8305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f462934a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.507511:0:8305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f462934a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788309576.507710:0:8305:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f462934a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.507722:0:8305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f462933c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.507735:0:8305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f462933c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.507742:0:8305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f462933c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.507748:0:8305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8d73ee400 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:3.0:1788309576.507752:0:8305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f462933c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.507760:0:8305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f462933c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.507772:0:8305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97c8d832f200) 00010000:00010000:3.0:1788309576.507775:0:8305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788309576.507779:0:8305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f462933c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.507786:0:8305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f462933c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.507797:0:8305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f4629343 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.507803:0:8305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f4629343 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.507809:0:8305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f4629343 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.507814:0:8305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8d73ef800 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:3.0:1788309576.507821:0:8305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f4629343 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.507828:0:8305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f4629343 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.507836:0:8305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97c8e2544c00) 00010000:00010000:3.0:1788309576.507838:0:8305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788309576.507842:0:8305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f4629343 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.507848:0:8305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f4629343 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.507861:0:8305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f462934a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.507867:0:8305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f462934a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.507873:0:8305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f462934a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.507877:0:8305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8c153bc00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:3.0:1788309576.507880:0:8305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f462934a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.507885:0:8305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f462934a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.507893:0:8305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c8d83f4c00) 00010000:00010000:3.0:1788309576.507895:0:8305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788309576.507903:0:8305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f462934a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.507909:0:8305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f462934a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309576.507976:0:8305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6585f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+32:11535:x1875178192718080:12345-192.168.202.55@tcp:34:lfs.0 Request processed in 985us (1182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309576.507984:0:8305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 194 00000100:00100000:3.0:1788309576.581929:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309576.582031:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192718336 00000100:00100000:1.0:1788309576.582042:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192718336 00000100:00100000:1.0:1788309576.582112:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 195 00000100:00100000:1.0:1788309576.582123:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffbb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+32:11538:x1875178192718336:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:1.0:1788309576.582142:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788309576.582165:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549200/0x63a04852f4629351 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146acbd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309576.582249:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4629358 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309576.582264:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4629358 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309576.582314:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4629358 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309576.582343:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f462935f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309576.582351:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f462935f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309576.582358:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f462935f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309576.582710:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548400/0x63a04852f4629366 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309576.582727:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548400/0x63a04852f4629366 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309576.582735:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548400/0x63a04852f4629366 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788309576.582747:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788309576.582838:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4629358 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309576.582846:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4629358 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309576.582854:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4629358 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309576.582860:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8f5548e00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:1.0:1788309576.582865:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4629358 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309576.582871:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4629358 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309576.582884:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97c8d832f200) 00010000:00010000:1.0:1788309576.582887:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788309576.582891:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4629358 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309576.582897:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f4629358 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309576.582909:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f462935f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309576.582921:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f462935f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309576.582927:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f462935f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309576.582932:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8f5548800 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:1.0:1788309576.582935:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f462935f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309576.582941:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f462935f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309576.582949:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97c8d832fa00) 00010000:00010000:1.0:1788309576.582952:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788309576.582954:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f462935f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309576.582961:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f462935f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309576.583002:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549200/0x63a04852f4629351 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146acbd expref: 35 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309576.583017:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548400/0x63a04852f4629366 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146acbd expref: 34 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309576.583026:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c8d83f4c00) 00010000:00010000:1.0:1788309576.583029:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788309576.583038:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8f5548400, rc 0) 00000100:00100000:1.0:1788309576.583102:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffbb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+34:11538:x1875178192718336:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 980us (1183us total) trans 4294967476 rc 0/0 00000100:00100000:1.0:1788309576.583109:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 195 00000100:00100000:0.0:1788309576.587789:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309576.587878:0:8305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192718464 00000100:00100000:3.0:1788309576.587889:0:8305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192718464 00000100:00100000:3.0:1788309576.587947:0:8305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 196 00000100:00100000:3.0:1788309576.587959:0:8305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6586300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+34:11538:x1875178192718464:12345-192.168.202.55@tcp:54:lfs.0 00010000:00010000:3.0:1788309576.588028:0:8305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4629374 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.588046:0:8305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4629319 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aca8 expref: 34 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.588056:0:8305:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4629374 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.588093:0:8305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4629319 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aca8 expref: 34 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.588107:0:8305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4629319 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aca8 expref: 34 pid: 5837 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309576.588121:0:8305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8edf30e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8305:1875178210536576:192.168.202.55@tcp:104: 00000100:00100000:3.0:1788309576.588243:0:8305:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8eff1e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788309576.598135:0:8305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8edf30e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8305:1875178210536576:192.168.202.55@tcp:104: 00010000:00010000:3.0:1788309576.598168:0:8305:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4629374 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309576.603225:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309576.603459:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192718720 00000100:00100000:2.0:1788309576.603470:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192718720 00000100:00100000:2.0:1788309576.603545:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 52 00000100:00100000:2.0:1788309576.603556:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6586d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+35:5590:x1875178192718720:12345-192.168.202.55@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788309576.603877:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6586d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+36:5590:x1875178192718720:12345-192.168.202.55@tcp:35:ldlm_bl.0 Request processed in 322us (661us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1788309576.603885:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 52 00000100:00100000:0.0:1788309576.617071:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309576.617196:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192718848 00000100:00100000:1.0:1788309576.617208:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192718848 00010000:00010000:1.0:1788309576.617250:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4629319 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aca8 expref: 36 pid: 5837 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309576.617326:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 73 00000100:00100000:1.0:1788309576.617339:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e697b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+36:2351:x1875178192718848:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788309576.617355:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788309576.617363:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4629319 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aca8 expref: 36 pid: 5837 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309576.617377:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4629319 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aca8 expref: 36 pid: 5837 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309576.617400:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4629319 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aca8 expref: 36 pid: 5837 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309576.617420:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c8d83f4c00) 00010000:00010000:1.0:1788309576.617425:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4629374 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309576.617436:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4629374 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309576.617445:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4629374 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309576.617673:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788309576.617786:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e697b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+35:2351:x1875178192718848:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 448us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309576.617802:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 73 00010000:00010000:3.0:1788309576.617867:0:8305:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4629374 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.617876:0:8305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4629374 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.617907:0:8305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4629374 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.617914:0:8305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4629374 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.617921:0:8305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4629374 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.617928:0:8305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8c153bc00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:3.0:1788309576.617932:0:8305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4629374 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.617940:0:8305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4629374 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.617949:0:8305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c8d83f4c00) 00010000:00010000:3.0:1788309576.617952:0:8305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788309576.617956:0:8305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4629374 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.617972:0:8305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4629374 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309576.618016:0:8305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6586300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+34:11538:x1875178192718464:12345-192.168.202.55@tcp:54:lfs.0 Request processed in 30060us (30236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309576.618024:0:8305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 196 00000100:00100000:0.0:1788309576.619910:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309576.620139:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192719104 00000100:00100000:2.0:1788309576.620148:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192719104 00000100:00100000:2.0:1788309576.620203:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 53 00000100:00100000:2.0:1788309576.620213:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e697bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+34:11538:x1875178192719104:12345-192.168.202.55@tcp:35:lfs.0 00000100:00100000:2.0:1788309576.620699:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e697bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+35:11538:x1875178192719104:12345-192.168.202.55@tcp:35:lfs.0 Request processed in 485us (794us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1788309576.620707:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 53 00000100:00100000:1.0:1788309576.838395:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309576.838502:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192719360 00000100:00100000:3.0:1788309576.838513:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192719360 00000100:00100000:3.0:1788309576.838584:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 197 00000100:00100000:3.0:1788309576.838595:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8efefad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+35:11550:x1875178192719360:12345-192.168.202.55@tcp:101:cat.0 00010000:00010000:3.0:1788309576.838621:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309576.838641:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f462937b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146acc4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.838716:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4629382 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.838731:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4629382 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.838741:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4629382 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.838756:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4629389 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.838762:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4629389 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.838788:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4629389 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.839083:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4629390 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.839092:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4629390 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.839100:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4629390 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788309576.839109:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:3.0:1788309576.839213:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4629382 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.839221:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4629382 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.839228:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4629382 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.839234:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8c153ac00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:3.0:1788309576.839238:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4629382 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.839246:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4629382 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.839257:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97c8d832f200) 00010000:00010000:3.0:1788309576.839260:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788309576.839272:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4629382 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.839309:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4629382 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.839322:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4629389 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.839328:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4629389 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.839334:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4629389 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.839339:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8c153a000 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:3.0:1788309576.839342:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4629389 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.839348:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4629389 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.839355:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97c8e2544c00) 00010000:00010000:3.0:1788309576.839358:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788309576.839361:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4629389 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.839366:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f4629389 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.839408:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f462937b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146acc4 expref: 38 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.839438:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4629390 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146acc4 expref: 37 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309576.839446:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c8d83f4c00) 00010000:00010000:3.0:1788309576.839448:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788309576.839451:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8c153a200, rc 0) 00000100:00100000:3.0:1788309576.839509:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8efefad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+37:11550:x1875178192719360:12345-192.168.202.55@tcp:101:cat.0 Request processed in 916us (1124us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1788309576.839516:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 197 00000100:00100000:0.0:1788309576.853490:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309576.860157:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192719616 00000100:00100000:3.0:1788309576.860173:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192719616 00000100:00100000:3.0:1788309576.860257:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 54 00000100:00100000:3.0:1788309576.860269:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6979c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+37:11550:x1875178192719616:12345-192.168.202.55@tcp:35:cat.0 00000100:00100000:3.0:1788309576.861053:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6979c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+38:11550:x1875178192719616:12345-192.168.202.55@tcp:35:cat.0 Request processed in 783us (7580us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1788309576.861062:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 54 00000100:00100000:0.0:1788309576.913507:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309576.914030:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192719872 00000100:00100000:2.0:1788309576.914041:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192719872 00000100:00100000:2.0:1788309576.914104:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 198 00000100:00100000:2.0:1788309576.914115:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e697b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+38:11551:x1875178192719872:12345-192.168.202.55@tcp:36:rm.0 00010000:00010000:2.0:1788309576.914180:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788309576.914224:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4629390 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146acc4 expref: 38 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309576.914247:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548400/0x63a04852f4629366 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146acbd expref: 37 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309576.914258:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f462932e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146acaf expref: 36 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309576.914351:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c8d83f4c00) 00010000:00010000:2.0:1788309576.914363:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788309576.914387:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f462939e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309576.914401:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f462939e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309576.914410:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f462939e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309576.914423:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9600/0x63a04852f46293a5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309576.914429:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9600/0x63a04852f46293a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309576.914435:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9600/0x63a04852f46293a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309576.918072:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f46293ac lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309576.918095:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f46293ac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309576.918107:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f46293ac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788309576.921346:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:2.0:1788309576.921361:0:5839:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 339672082990ns, next at 340672079899ns, rc = 0 00010000:00010000:2.0:1788309576.921441:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f46293b3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309576.921458:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f46293b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309576.921469:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f46293b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309576.921478:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f46293b3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309576.921484:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f46293b3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309576.921492:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f46293b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309576.921510:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788309576.921532:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f46293ac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309576.921819:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788309576.921827:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f46293b3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309576.922050:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f46293ac lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309576.922057:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f46293ac lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309576.922844:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d9c00 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:0.0:1788309576.922851:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f46293b3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309576.922861:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f46293b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309576.922876:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c8d83f4b00) 00010000:00010000:0.0:1788309576.922879:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788309576.922883:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f46293b3 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309576.922888:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f46293b3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309576.922967:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309576.922970:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309576.922972:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309576.925026:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d9a00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309576.925038:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f46293ac lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309576.925051:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f46293ac lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309576.925088:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c8d83f4b00) 00010000:00010000:2.0:1788309576.925091:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788309576.925095:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f46293ac lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309576.925103:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f46293ac lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309576.925144:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f462939e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309576.925151:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f462939e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309576.925157:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f462939e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309576.925163:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d8c00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309576.925165:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f462939e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309576.925170:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f462939e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309576.925178:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97c8d832f200) 00010000:00010000:2.0:1788309576.925180:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788309576.925191:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f462939e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309576.925197:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f462939e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788309576.925218:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ca43a17d reply state 00000000da44045d transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9600/0x63a04852f46293a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309576.925227:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788309576.925501:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e697b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+37:11551:x1875178192719872:12345-192.168.202.55@tcp:36:rm.0 Request processed in 11381us (12000us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1788309576.925510:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 198 00010000:00010000:0.0:1788309576.929834:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9600/0x63a04852f46293a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309576.929852:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9600/0x63a04852f46293a5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309576.929859:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9600/0x63a04852f46293a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309576.929878:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d9600 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:0.0:1788309576.929882:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9600/0x63a04852f46293a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309576.929890:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9600/0x63a04852f46293a5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309576.929908:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97c8d83f4500) 00010000:00010000:0.0:1788309576.929910:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788309576.929915:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9600/0x63a04852f46293a5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309576.929921:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9600/0x63a04852f46293a5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309577.013454:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309577.014439:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192720128 00000100:00100000:3.0:1788309577.014451:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192720128 00000100:00100000:3.0:1788309577.014546:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 199 00000100:00100000:3.0:1788309577.014559:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6979880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+36:11557:x1875178192720128:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:3.0:1788309577.014584:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309577.014605:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f46293ba lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146accb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.014741:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f46293c1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.014772:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f46293c1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.014784:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f46293c1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.014799:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f46293c8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.014806:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f46293c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.014813:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f46293c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788309577.015382:0:5838:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:3.0:1788309577.015570:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f46293cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.015580:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f46293cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.015588:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f46293cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.015626:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f46293c1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.015634:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f46293c1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.015642:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f46293c1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.015655:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8c153a000 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:3.0:1788309577.015660:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f46293c1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.015668:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f46293c1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.015681:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97c8d832f200) 00010000:00010000:3.0:1788309577.015684:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788309577.015689:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f46293c1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.015695:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f46293c1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788309577.015709:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005976de48 reply state 00000000f635bf1d transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f46293c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309577.015717:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788309577.015748:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f46293ba lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146accb expref: 39 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.015764:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f46293cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146accb expref: 38 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.015771:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97c8e2544700) 00010000:00010000:3.0:1788309577.015774:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788309577.015776:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8c153a200, rc 0) 00000100:00100000:3.0:1788309577.015841:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6979880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+39:11557:x1875178192720128:12345-192.168.202.55@tcp:101:bash.0 Request processed in 1285us (2397us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1788309577.015854:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 199 00000100:00080000:1.0:1788309577.016219:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788309577.020809:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f46293c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309577.020830:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f46293c8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309577.020838:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f46293c8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309577.020844:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8c153ac00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309577.020849:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f46293c8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309577.020858:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f46293c8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309577.020876:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97c8e2544c00) 00010000:00010000:2.0:1788309577.020879:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788309577.020883:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f46293c8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309577.020889:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f46293c8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309577.026807:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309577.027090:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192720256 00000100:00100000:2.0:1788309577.027104:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192720256 00000100:00100000:2.0:1788309577.027198:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 59 00000100:00100000:2.0:1788309577.027211:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6979180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+5:2350:x1875178192720256:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:2.0:1788309577.027234:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309577.027261:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ffbeb46a/0x63a04852f46293dd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146acd2 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788309577.027324:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788309577.027347:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=339s v=(0 0) 00010000:00010000:2.0:1788309577.027353:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788309577.027364:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffbeb46a/0x63a04852f46293dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146acd2 expref: 6 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309577.027383:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ffbeb46a/0x63a04852f46293dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146acd2 expref: 6 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309577.027398:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8e26d8c00, rc 0) 00000100:00100000:2.0:1788309577.027476:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6979180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:2350:x1875178192720256:12345-192.168.202.55@tcp:101:bash.0 Request processed in 267us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309577.027483:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 59 00000100:00080000:3.0:1788309577.028750:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788309577.033131:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309577.033218:0:12478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192720384 00000100:00100000:2.0:1788309577.033228:0:12478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192720384 00000100:00100000:2.0:1788309577.033321:0:12478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 60 00000100:00100000:2.0:1788309577.033333:0:12478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8edf30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:11557:x1875178192720384:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:2.0:1788309577.033368:0:12478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309577.033388:0:12478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b87a48d4/0x63a04852f46293e4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146acd9 expref: -99 pid: 12478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309577.033425:0:12478:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ffbeb46a/0x63a04852f46293dd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146acd2 expref: 7 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309577.033434:0:12478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788309577.033439:0:12478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788309577.033444:0:12478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b87a48d4/0x63a04852f46293e4 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146acd9 expref: 7 pid: 12478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309577.033480:0:12478:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ffbeb46a/0x63a04852f46293dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146acd2 expref: 7 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309577.033495:0:12478:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ffbeb46a/0x63a04852f46293dd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146acd2 expref: 7 pid: 6682 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309577.033509:0:12478:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8f4ce1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12478:1875178210536704:192.168.202.55@tcp:104: 00000100:00100000:2.0:1788309577.033608:0:12478:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8f51d7180 going to sleep for 11 seconds 00000100:00100000:0.0:1788309577.041024:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309577.041127:0:12478:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8f4ce1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12478:1875178210536704:192.168.202.55@tcp:104: 00010000:00010000:2.0:1788309577.041164:0:12478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b87a48d4/0x63a04852f46293e4 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146acd9 expref: 7 pid: 12478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309577.041196:0:12478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8e26d9a00, rc 0) 00000100:00100000:2.0:1788309577.041305:0:12478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8edf30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+7:11557:x1875178192720384:12345-192.168.202.55@tcp:101:bash.0 Request processed in 7946us (8157us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309577.041315:0:12478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 60 00000100:00100000:3.0:1788309577.041993:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192720512 00000100:00100000:3.0:1788309577.042003:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192720512 00010000:00010000:3.0:1788309577.042039:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ffbeb46a/0x63a04852f46293dd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146acd2 expref: 7 pid: 6682 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309577.042076:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 74 00000100:00100000:3.0:1788309577.042086:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e697a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+7:2351:x1875178192720512:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788309577.042099:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788309577.042125:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ffbeb46a/0x63a04852f46293dd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146acd2 expref: 7 pid: 6682 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.042138:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ffbeb46a/0x63a04852f46293dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146acd2 expref: 7 pid: 6682 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.042161:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ffbeb46a/0x63a04852f46293dd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146acd2 expref: 7 pid: 6682 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.042176:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788309577.042190:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788309577.042199:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b87a48d4/0x63a04852f46293e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146acd9 expref: 6 pid: 12478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.042223:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b87a48d4/0x63a04852f46293e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146acd9 expref: 6 pid: 12478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.042258:0:5821:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b87a48d4/0x63a04852f46293e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146acd9 expref: 6 pid: 12478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309577.042272:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8edf33100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5821:1875178210536832:192.168.202.55@tcp:105: 00000100:00100000:3.0:1788309577.042386:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8eff1ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1788309577.047823:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309577.048051:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8edf33100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5821:1875178210536832:192.168.202.55@tcp:105: 00010000:00010000:3.0:1788309577.048073:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788309577.048132:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e697a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:2351:x1875178192720512:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 6046us (7118us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309577.048143:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 74 00000100:00100000:1.0:1788309577.048238:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192720768 00000100:00100000:1.0:1788309577.048246:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192720768 00000100:00100000:1.0:1788309577.048323:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 55 00000100:00100000:1.0:1788309577.048334:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecdc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+38:11557:x1875178192720768:12345-192.168.202.55@tcp:35:bash.0 00000100:00100000:1.0:1788309577.048677:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecdc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+39:11557:x1875178192720768:12345-192.168.202.55@tcp:35:bash.0 Request processed in 345us (866us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1788309577.048684:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 55 00000100:00100000:2.0:1788309577.332921:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309577.333027:0:8305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192720896 00000100:00100000:3.0:1788309577.333047:0:8305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192720896 00000100:00100000:3.0:1788309577.333107:0:8305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 200 00000100:00100000:3.0:1788309577.333118:0:8305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f4ce1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+39:11573:x1875178192720896:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:3.0:1788309577.333144:0:8305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309577.333165:0:8305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f46293eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ace0 expref: -99 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.333243:0:8305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f46293f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.333258:0:8305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f46293f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.333323:0:8305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f46293f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788309577.333393:0:8305:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1788309577.333397:0:8305:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1788309577.333418:0:8305:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f46293f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.333445:0:8305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f46293eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ace0 expref: 41 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.333468:0:8305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f46293f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ace0 expref: 40 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.333476:0:8305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97c8d832f200) 00010000:00010000:3.0:1788309577.333479:0:8305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788309577.333482:0:8305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8c153a000, rc 0) 00000100:00100000:3.0:1788309577.333761:0:8305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f4ce1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+40:11573:x1875178192720896:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 643us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309577.333769:0:8305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 200 00000100:00100000:0.0:1788309577.339403:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309577.339665:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192721152 00000100:00100000:3.0:1788309577.339677:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192721152 00000100:00100000:3.0:1788309577.339735:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 201 00000100:00100000:3.0:1788309577.339746:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecdc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+40:11573:x1875178192721152:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:3.0:1788309577.339769:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309577.339792:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f46293f9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ace7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.339938:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4629400 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.339952:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4629400 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.339964:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4629400 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788309577.339976:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788309577.340330:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f46293f9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ace7 expref: 43 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.340351:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4629400 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ace7 expref: 42 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.340361:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97c8e2544700) 00010000:00010000:3.0:1788309577.340364:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788309577.340367:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8c153ac00, rc 0) 00000100:00100000:3.0:1788309577.340465:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecdc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+42:11573:x1875178192721152:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 719us (1071us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1788309577.340481:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 201 00000100:00100000:0.0:1788309577.346877:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309577.346956:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309577.347217:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192721536 00000100:00100000:2.0:1788309577.347226:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192721536 00000100:00100000:2.0:1788309577.347321:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 202 00000100:00100000:2.0:1788309577.347334:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecdc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+42:11573:x1875178192721536:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:2.0:1788309577.347363:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309577.347388:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f462940e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146acee expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309577.347852:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4629415 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309577.347870:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4629415 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309577.347882:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4629415 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788309577.347896:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788309577.348163:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f462940e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146acee expref: 45 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309577.348196:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4629415 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146acee expref: 44 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309577.348206:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97c8e2544700) 00010000:00010000:2.0:1788309577.348223:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788309577.348228:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8e26d8c00, rc 0) 00000100:00100000:2.0:1788309577.348922:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecdc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+44:11573:x1875178192721536:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 1588us (1962us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1788309577.348931:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 202 00000100:00100000:3.0:1788309577.349216:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192721280 00000100:00100000:3.0:1788309577.349224:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192721280 00000100:00100000:3.0:1788309577.349383:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 15 00000100:00100000:3.0:1788309577.349393:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6b29050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+44:2351:x1875178192721280:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788309577.349408:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788309577.349438:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4629400 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ace7 expref: 44 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.349453:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97c8e2544700) 00010000:00010000:3.0:1788309577.349457:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788309577.349503:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6b29050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+43:2351:x1875178192721280:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 111us (2636us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309577.349510:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 15 00000100:00100000:2.0:1788309577.356967:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309577.357767:0:10673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192721664 00000100:00100000:0.0:1788309577.357780:0:10673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192721664 00000100:00100000:0.0:1788309577.357848:0:10673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 61 00000100:00100000:0.0:1788309577.357859:0:10673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f4ce1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+6:2353:x1875178192721664:12345-192.168.202.55@tcp:1:lfs.0 00010000:00010000:0.0:1788309577.357902:0:10673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcfdf2cb/0x63a04852f4629423 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309577.357941:0:10673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b87a48d4/0x63a04852f46293e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146acd9 expref: 6 pid: 12478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309577.357950:0:10673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788309577.357955:0:10673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788309577.357959:0:10673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcfdf2cb/0x63a04852f4629423 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309577.357995:0:10673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b87a48d4/0x63a04852f46293e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146acd9 expref: 6 pid: 12478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309577.358010:0:10673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b87a48d4/0x63a04852f46293e4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146acd9 expref: 6 pid: 12478 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309577.358241:0:10673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecf14e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10673:1875178210536960:192.168.202.55@tcp:104: 00000100:00100000:0.0:1788309577.358524:0:10673:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d6932600 going to sleep for 11 seconds 00000100:00100000:3.0:1788309577.362828:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309577.362991:0:10673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecf14e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10673:1875178210536960:192.168.202.55@tcp:104: 00010000:00010000:2.0:1788309577.363032:0:10673:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fcfdf2cb/0x63a04852f4629423 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309577.363386:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192721792 00000100:00100000:1.0:1788309577.363395:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192721792 00002000:00100000:1.0:1788309577.363447:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff97c8edf30a80 x1875178192721792/t0(0) o4->86451057-f8bb-4d7c-a7c2-5c834b43e3d3@192.168.202.55@tcp:733/0 lens 504/0 e 0 to 0 dl 1788309588 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788309577.363457:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97c8edf30a80 with x1875178192721792 ext(0->8) 00010000:00010000:1.0:1788309577.363466:0:6688:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000b87a48d4/0x63a04852f46293e4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146acd9 expref: 7 pid: 12478 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309577.363480:0:6688:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000b87a48d4/0x63a04852f46293e4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146acd9 expref: 7 pid: 12478 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788309577.363489:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff97c8edf30a80 00000100:00100000:1.0:1788309577.363524:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 3 00000100:00100000:1.0:1788309577.363568:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8edf30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+7:2351:x1875178192721792:12345-192.168.202.55@tcp:4:lfs.0 00000100:00100000:1.0:1788309577.364312:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8edf30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+9:2351:x1875178192721792:12345-192.168.202.55@tcp:4:lfs.0 Request processed in 722us (1462us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788309577.364321:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 3 00002000:00100000:1.0:1788309577.364330:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff97c8edf30a80 x1875178192721792/t4294967308(0) o4->86451057-f8bb-4d7c-a7c2-5c834b43e3d3@192.168.202.55@tcp:733/0 lens 504/448 e 0 to 0 dl 1788309588 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788309577.364339:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97c8edf30a80 with x1875178192721792 ext(0->8) 00010000:00010000:1.0:1788309577.364346:0:6688:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000b87a48d4/0x63a04852f46293e4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146acd9 expref: 9 pid: 12478 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309577.364359:0:6688:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000b87a48d4/0x63a04852f46293e4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146acd9 expref: 9 pid: 12478 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788309577.364366:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff97c8edf30a80 00000100:00100000:2.0:1788309577.369718:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309577.369818:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192721920 00000100:00100000:0.0:1788309577.369828:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192721920 00010000:00010000:0.0:1788309577.369871:0:8447:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b87a48d4/0x63a04852f46293e4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146acd9 expref: 9 pid: 12478 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309577.369915:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 75 00000100:00100000:0.0:1788309577.369925:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f4ce0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+9:2352:x1875178192721920:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788309577.369940:0:8447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788309577.369972:0:8447:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788309577.369975:0:8447:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788309576 00002000:00010000:0.0:1788309577.369977:0:8447:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788309577 00002000:00010000:0.0:1788309577.369979:0:8447:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788309576 00010000:00010000:0.0:1788309577.369986:0:8447:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b87a48d4/0x63a04852f46293e4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146acd9 expref: 9 pid: 12478 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309577.370002:0:8447:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b87a48d4/0x63a04852f46293e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146acd9 expref: 9 pid: 12478 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309577.370208:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b87a48d4/0x63a04852f46293e4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146acd9 expref: 9 pid: 12478 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309577.370229:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788309577.370234:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788309577.370239:0:8447:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fcfdf2cb/0x63a04852f4629423 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309577.370250:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcfdf2cb/0x63a04852f4629423 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309577.370332:0:8447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788309577.370389:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f4ce0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+8:2352:x1875178192721920:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 464us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309577.370398:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 75 00010000:00010000:2.0:1788309577.370516:0:10673:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fcfdf2cb/0x63a04852f4629423 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309577.370526:0:10673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcfdf2cb/0x63a04852f4629423 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309577.370562:0:10673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcfdf2cb/0x63a04852f4629423 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309577.370572:0:10673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcfdf2cb/0x63a04852f4629423 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309577.370580:0:10673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcfdf2cb/0x63a04852f4629423 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309577.370601:0:10673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8ecf2f400 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:2.0:1788309577.370605:0:10673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcfdf2cb/0x63a04852f4629423 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309577.370615:0:10673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcfdf2cb/0x63a04852f4629423 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309577.370628:0:10673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcfdf2cb/0x63a04852f4629423 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309577.370635:0:10673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcfdf2cb/0x63a04852f4629423 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309577.370683:0:10673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f4ce1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+7:2353:x1875178192721664:12345-192.168.202.55@tcp:1:lfs.0 Request processed in 12826us (13726us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309577.370691:0:10673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 61 00000100:00100000:0.0:1788309577.379554:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309577.379791:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192722176 00000100:00100000:1.0:1788309577.379802:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192722176 00000100:00100000:1.0:1788309577.379862:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 56 00000100:00100000:1.0:1788309577.379872:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e663a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+43:11573:x1875178192722176:12345-192.168.202.55@tcp:35:lfs.0 00000004:00010000:1.0:1788309577.379935:0:5841:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4629415 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146acee expref: 43 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788309577.380834:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:1.0:1788309577.380881:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:1.0:1788309577.382141:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:1.0:1788309577.382226:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f462942a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309577.382265:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f46293cf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146accb expref: 47 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309577.382274:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f462942a lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309577.382468:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f46293cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146accb expref: 47 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309577.382658:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f46293cf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146accb expref: 47 pid: 5838 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309577.382676:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8efef9f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5841:1875178210537088:192.168.202.55@tcp:104: 00000100:00100000:1.0:1788309577.382952:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8e6bc1780 going to sleep for 11 seconds 00000100:00100000:3.0:1788309577.386738:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309577.386854:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8efef9f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5841:1875178210537088:192.168.202.55@tcp:104: 00010000:00010000:1.0:1788309577.386882:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f462942a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309577.387188:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192722304 00000100:00100000:2.0:1788309577.387196:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192722304 00010000:00010000:2.0:1788309577.387237:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f46293cf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146accb expref: 48 pid: 5838 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309577.387323:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 76 00000100:00100000:2.0:1788309577.387333:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8edf33100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+48:2350:x1875178192722304:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788309577.387349:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788309577.387355:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f46293cf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146accb expref: 48 pid: 5838 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309577.387379:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f46293cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146accb expref: 48 pid: 5838 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309577.387401:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f46293cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146accb expref: 48 pid: 5838 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309577.387416:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97c8e2544700) 00010000:00010000:2.0:1788309577.387420:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f462942a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309577.387429:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f462942a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309577.387436:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f462942a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309577.387461:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788309577.387507:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8edf33100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+47:2350:x1875178192722304:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 176us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309577.387514:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 76 00010000:00010000:3.0:1788309577.388321:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f462942a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.388333:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f462942a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788309577.388468:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:3.0:1788309577.388675:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:3.0:1788309577.388768:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8edf33480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5841:1875178210537216:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788309577.388817:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309577.388848:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8eff1ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1788309577.389345:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210537216 00000100:00100000:0.0:1788309577.389361:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210537216 00000100:00100000:0.0:1788309577.389412:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788309577.389420:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffbb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5841:x1875178210537216:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788309577.389501:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffbb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5841:x1875178210537216:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 81us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309577.389508:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788309577.389601:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8edf33480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5841:1875178210537216:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788309577.389973:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:1.0:1788309577.390027:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8efef9f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5841:1875178210537344:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788309577.390071:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309577.390095:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8e6bc1480 going to sleep for 11 seconds 00000100:00100000:0.0:1788309577.390316:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210537344 00000100:00100000:0.0:1788309577.390321:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210537344 00000100:00100000:0.0:1788309577.390341:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788309577.390347:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8efef9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5841:x1875178210537344:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788309577.390501:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8efef9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5841:x1875178210537344:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 153us (429us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788309577.390508:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1788309577.391107:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788309577.391238:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8efef9f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5841:1875178210537344:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788309577.391332:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:1.0:1788309577.391392:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f462942a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309577.391403:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f462942a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309577.391410:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f462942a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309577.391416:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8f5548e00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:1.0:1788309577.391422:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f462942a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309577.391429:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f462942a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309577.391448:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97c8e2544700) 00010000:00010000:1.0:1788309577.391451:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788309577.391456:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f462942a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309577.391462:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548e00/0x63a04852f462942a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788309577.391957:0:5841:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788309577.392214:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:1.0:1788309577.392226:0:5841:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 340142948268ns, next at 341142945584ns, rc = 0 00000001:00080000:1.0:1788309577.392234:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:1.0:1788309577.392274:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97c8e2544700) 00010000:00010000:1.0:1788309577.392309:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788309577.392318:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4629415 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146acee expref: 51 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309577.392444:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e663a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+50:11573:x1875178192722176:12345-192.168.202.55@tcp:35:lfs.0 Request processed in 12572us (12900us total) trans 4294967494 rc 0/0 00000100:00100000:1.0:1788309577.392453:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 56 00000020:00080000:1.0:1788309577.392458:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788309577.396025:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309577.396987:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192722432 00000100:00100000:2.0:1788309577.397002:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192722432 00000100:00100000:2.0:1788309577.397169:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 203 00000100:00100000:2.0:1788309577.397192:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffbb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+50:11573:x1875178192722432:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:2.0:1788309577.397219:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309577.397245:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4629431 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146acf5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309577.397453:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4629431 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146acf5 expref: 51 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309577.397468:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4629431 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146acf5 expref: 51 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309577.397493:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97c8d83f4b00) 00010000:00010000:2.0:1788309577.397496:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788309577.397500:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8e26d9c00, rc 0) 00000100:00100000:2.0:1788309577.397586:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffbb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+51:11573:x1875178192722432:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 406us (1573us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309577.397594:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 203 00000100:00100000:0.0:1788309577.401104:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309577.401195:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192722688 00000100:00100000:1.0:1788309577.401206:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192722688 00000100:00100000:1.0:1788309577.401262:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 57 00000100:00100000:1.0:1788309577.401272:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecf17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+51:11573:x1875178192722688:12345-192.168.202.55@tcp:35:lfs.0 00000100:00100000:1.0:1788309577.401509:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecf17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+52:11573:x1875178192722688:12345-192.168.202.55@tcp:35:lfs.0 Request processed in 239us (415us total) trans 4294967495 rc 0/0 00000100:00100000:1.0:1788309577.401517:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 57 00010000:00010000:1.0:1788309577.442098:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788309577.503916:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309577.504050:0:8305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192722816 00000100:00100000:3.0:1788309577.504062:0:8305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192722816 00000100:00100000:3.0:1788309577.504188:0:8305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 204 00000100:00100000:3.0:1788309577.504201:0:8305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecf14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+52:11583:x1875178192722816:12345-192.168.202.55@tcp:34:lfs.0 00010000:00010000:3.0:1788309577.504414:0:8305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4629438 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.504445:0:8305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4629438 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.504458:0:8305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4629438 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.504485:0:8305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f462943f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.504493:0:8305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f462943f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.504500:0:8305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f462943f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.504755:0:8305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4629446 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.504763:0:8305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4629446 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.504770:0:8305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4629446 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788309577.504814:0:8305:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4629446 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.504828:0:8305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4629438 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.504834:0:8305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4629438 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.504851:0:8305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4629438 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.504856:0:8305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8c153ac00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:3.0:1788309577.504861:0:8305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4629438 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.504869:0:8305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4629438 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.504882:0:8305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97c8d832f200) 00010000:00010000:3.0:1788309577.504886:0:8305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788309577.504890:0:8305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4629438 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.504896:0:8305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4629438 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.504909:0:8305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f462943f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.504915:0:8305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f462943f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.504920:0:8305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f462943f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.504925:0:8305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8c153bc00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:3.0:1788309577.504927:0:8305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f462943f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.504940:0:8305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f462943f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.504948:0:8305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97c8e2544900) 00010000:00010000:3.0:1788309577.504949:0:8305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788309577.504952:0:8305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f462943f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.504957:0:8305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f462943f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.504971:0:8305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4629446 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.504978:0:8305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4629446 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.504983:0:8305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4629446 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.504988:0:8305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8c153a200 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:3.0:1788309577.504990:0:8305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4629446 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.504996:0:8305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4629446 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.505001:0:8305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97c8d83f4b00) 00010000:00010000:3.0:1788309577.505003:0:8305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788309577.505006:0:8305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4629446 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.505020:0:8305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f4629446 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309577.505090:0:8305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecf14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+52:11583:x1875178192722816:12345-192.168.202.55@tcp:34:lfs.0 Request processed in 891us (1186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309577.505098:0:8305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 204 00000100:00100000:0.0:1788309577.550242:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309577.550376:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192723072 00000100:00100000:3.0:1788309577.550387:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192723072 00000100:00100000:3.0:1788309577.550455:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 205 00000100:00100000:3.0:1788309577.550468:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecf17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+52:11586:x1875178192723072:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:3.0:1788309577.550498:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309577.550521:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f462944d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146acfc expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.551322:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4629454 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.551340:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4629454 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.551351:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4629454 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.551366:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f462945b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.551373:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f462945b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.551400:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f462945b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.551550:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4629462 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.551566:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4629462 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.551574:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4629462 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788309577.551585:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788309577.551686:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4629454 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.551692:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4629454 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.551696:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4629454 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.551700:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8c153bc00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:3.0:1788309577.551703:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4629454 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.551708:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4629454 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.551717:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97c8d832f200) 00010000:00010000:3.0:1788309577.551719:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788309577.551729:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4629454 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.551733:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f4629454 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.551745:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f462945b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.551749:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f462945b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.551752:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f462945b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.551755:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8c153ac00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:3.0:1788309577.551756:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f462945b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.551760:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f462945b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.551763:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97c8e2544900) 00010000:00010000:3.0:1788309577.551765:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788309577.551766:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f462945b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.551769:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f462945b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.551802:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f462944d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146acfc expref: 55 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.551820:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4629462 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146acfc expref: 54 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.551825:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97c8d83f4b00) 00010000:00010000:3.0:1788309577.551826:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788309577.551828:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8d73eee00, rc 0) 00000100:00100000:3.0:1788309577.551879:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecf17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+54:11586:x1875178192723072:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 1414us (1649us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1788309577.551884:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 205 00000100:00100000:0.0:1788309577.573848:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309577.573950:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192723200 00000100:00100000:2.0:1788309577.573964:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192723200 00000100:00100000:2.0:1788309577.574028:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 206 00000100:00100000:2.0:1788309577.574038:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecf15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+54:11586:x1875178192723200:12345-192.168.202.55@tcp:54:lfs.0 00010000:00010000:2.0:1788309577.574124:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4629470 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309577.574142:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4629470 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309577.574155:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4629470 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309577.574192:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4629470 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309577.574218:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4629470 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309577.574225:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4629470 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309577.574232:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d9a00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309577.574236:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4629470 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309577.574244:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4629470 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309577.574256:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97c8d83f4b00) 00010000:00010000:2.0:1788309577.574259:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788309577.574263:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4629470 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309577.574269:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4629470 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309577.574378:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecf15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+54:11586:x1875178192723200:12345-192.168.202.55@tcp:54:lfs.0 Request processed in 341us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309577.574386:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 206 00000100:00100000:3.0:1788309577.581136:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309577.581827:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192723456 00000100:00100000:1.0:1788309577.581838:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192723456 00000100:00100000:1.0:1788309577.581934:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 58 00000100:00100000:1.0:1788309577.581947:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6586d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+54:11586:x1875178192723456:12345-192.168.202.55@tcp:35:lfs.0 00000100:00100000:1.0:1788309577.582222:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6586d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+55:11586:x1875178192723456:12345-192.168.202.55@tcp:35:lfs.0 Request processed in 278us (2953us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1788309577.582231:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 58 00000100:00100000:0.0:1788309577.688014:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309577.688334:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192723712 00000100:00100000:2.0:1788309577.688345:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192723712 00000100:00100000:2.0:1788309577.688418:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 207 00000100:00100000:2.0:1788309577.688428:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecf15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+55:11596:x1875178192723712:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:2.0:1788309577.688455:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309577.688467:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788309577.688494:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f46293f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ace0 expref: 55 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309577.688513:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97c8d832f200) 00010000:00010000:2.0:1788309577.688518:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788309577.688541:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4629477 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ad03 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309577.688647:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9600/0x63a04852f462947e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309577.688662:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9600/0x63a04852f462947e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309577.688673:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9600/0x63a04852f462947e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788309577.688682:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788309577.688816:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4629477 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad03 expref: 57 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309577.688833:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9600/0x63a04852f462947e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad03 expref: 56 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309577.688841:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97c8d83f4b00) 00010000:00010000:2.0:1788309577.688844:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788309577.688846:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8e26d9600, rc 0) 00000100:00100000:2.0:1788309577.688920:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecf15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+56:11596:x1875178192723712:12345-192.168.202.55@tcp:101:bash.0 Request processed in 493us (916us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1788309577.688938:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 207 00000100:00100000:0.0:1788309577.702620:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309577.702733:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309577.702815:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192724096 00000100:00100000:2.0:1788309577.702826:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192724096 00000100:00100000:2.0:1788309577.702886:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 208 00000100:00100000:2.0:1788309577.702897:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecf16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+56:11596:x1875178192724096:12345-192.168.202.55@tcp:36:bash.0 00010000:00010000:2.0:1788309577.702966:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788309577.702993:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4629462 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146acfc expref: 56 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309577.703040:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97c8d83f4b00) 00010000:00010000:2.0:1788309577.703046:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788309577.703475:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f462948c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309577.703489:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9600/0x63a04852f462947e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad03 expref: 56 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309577.703497:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f462948c lrc: 4/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309577.703597:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9600/0x63a04852f462947e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad03 expref: 56 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309577.703614:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9600/0x63a04852f462947e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad03 expref: 56 pid: 5837 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309577.703628:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e6b4ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875178210537472:192.168.202.55@tcp:104: 00000100:00100000:2.0:1788309577.703735:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8f51d7540 going to sleep for 11 seconds 00000100:00100000:3.0:1788309577.703832:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192723840 00000100:00100000:3.0:1788309577.703837:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192723840 00010000:00010000:3.0:1788309577.703859:0:8447:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9600/0x63a04852f462947e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad03 expref: 57 pid: 5837 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309577.703971:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 77 00000100:00100000:3.0:1788309577.703980:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecf15500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+57:2350:x1875178192723840:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788309577.703990:0:8447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788309577.703995:0:8447:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9600/0x63a04852f462947e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad03 expref: 57 pid: 5837 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.704006:0:8447:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9600/0x63a04852f462947e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad03 expref: 57 pid: 5837 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.704033:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97c8d83f4b00) 00010000:00010000:3.0:1788309577.704043:0:8447:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f462948c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.704050:0:8447:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f462948c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.704055:0:8447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f462948c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.704070:0:8447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788309577.704110:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecf15500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+57:2350:x1875178192723840:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 131us (1502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309577.704118:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 77 00010000:00010000:2.0:1788309577.707492:0:5839:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.55@tcp) returned -22 from blocking AST (req@00000000227aa37b x1875178210537472) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9600/0x63a04852f462947e lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad03 expref: 56 pid: 5837 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309577.707521:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9600/0x63a04852f462947e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad03 expref: 56 pid: 5837 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309577.707541:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e6b4ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875178210537472:192.168.202.55@tcp:104: 00010000:00010000:2.0:1788309577.707721:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97c8d83f4b00) 00010000:00010000:2.0:1788309577.707730:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f462948c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309577.707738:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f462948c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309577.707744:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f462948c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788309577.707872:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:2.0:1788309577.707923:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000554d28bb reply state 00000000bfd89180 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f462948c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309577.707932:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788309577.711827:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecf16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+57:11596:x1875178192724096:12345-192.168.202.55@tcp:36:bash.0 Request processed in 8918us (9078us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1788309577.711840:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 208 00000020:00080000:2.0:1788309577.711849:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788309577.716444:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f462948c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309577.716463:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f462948c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309577.716471:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f462948c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309577.716496:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d8c00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:0.0:1788309577.716502:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f462948c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309577.716510:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f462948c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309577.716537:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97c8d83f4b00) 00010000:00010000:0.0:1788309577.716540:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788309577.716545:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f462948c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309577.716552:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f462948c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309577.719849:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309577.719922:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192724224 00000100:00100000:2.0:1788309577.719934:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192724224 00000100:00100000:2.0:1788309577.720015:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 209 00000100:00100000:2.0:1788309577.720027:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecf14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+56:11596:x1875178192724224:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:2.0:1788309577.720106:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309577.720128:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4629493 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ad0a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309577.720690:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934c00/0x63a04852f462949a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309577.720706:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934c00/0x63a04852f462949a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309577.720720:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934c00/0x63a04852f462949a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788309577.720759:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788309577.720764:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788309577.720788:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934c00/0x63a04852f462949a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309577.720821:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4629493 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad0a expref: 58 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309577.720842:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934c00/0x63a04852f462949a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad0a expref: 57 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309577.720851:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97c8d83f4b00) 00010000:00010000:2.0:1788309577.720855:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788309577.720858:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8fc934c00, rc 0) 00000100:00100000:2.0:1788309577.720926:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecf14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+57:11596:x1875178192724224:12345-192.168.202.55@tcp:101:bash.0 Request processed in 901us (1090us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309577.720939:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 209 00000100:00100000:1.0:1788309577.727546:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309577.727943:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192724480 00000100:00100000:3.0:1788309577.727955:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192724480 00000100:00100000:3.0:1788309577.728114:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 59 00000100:00100000:3.0:1788309577.728126:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e667f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+57:11596:x1875178192724480:12345-192.168.202.55@tcp:35:bash.0 00000100:00100000:3.0:1788309577.728419:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e667f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+58:11596:x1875178192724480:12345-192.168.202.55@tcp:35:bash.0 Request processed in 294us (891us total) trans 4294967501 rc 0/0 00000100:00100000:3.0:1788309577.728426:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 59 00000100:00100000:1.0:1788309577.816683:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309577.816933:0:8305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192724608 00000100:00100000:0.0:1788309577.816943:0:8305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192724608 00000100:00100000:0.0:1788309577.817010:0:8305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 210 00000100:00100000:0.0:1788309577.817020:0:8305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecdc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+58:11602:x1875178192724608:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:0.0:1788309577.817046:0:8305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788309577.817067:0:8305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f600/0x63a04852f46294a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ad11 expref: -99 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309577.817139:0:8305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e800/0x63a04852f46294a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309577.817154:0:8305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e800/0x63a04852f46294a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309577.817195:0:8305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e800/0x63a04852f46294a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788309577.817348:0:8305:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1788309577.817352:0:8305:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1788309577.817377:0:8305:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e800/0x63a04852f46294a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309577.817403:0:8305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f600/0x63a04852f46294a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad11 expref: 60 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309577.817425:0:8305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e800/0x63a04852f46294a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad11 expref: 59 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309577.817434:0:8305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97c8d832f200) 00010000:00010000:0.0:1788309577.817437:0:8305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788309577.817441:0:8305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8ecf2e800, rc 0) 00000100:00100000:0.0:1788309577.817764:0:8305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecdc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+59:11602:x1875178192724608:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 743us (1092us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309577.817771:0:8305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 210 00000100:00100000:0.0:1788309577.822033:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309577.822152:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192724736 00000100:00100000:3.0:1788309577.822161:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192724736 00000100:00100000:3.0:1788309577.822232:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 211 00000100:00100000:3.0:1788309577.822242:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c958ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+59:11602:x1875178192724736:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:3.0:1788309577.822262:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309577.822326:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f46294af lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ad18 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.822391:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f46294b6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.822418:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f46294b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.822431:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f46294b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.822447:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f46294bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.822454:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f46294bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.822461:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f46294bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.822741:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f46294c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.822751:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f46294c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.822759:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f46294c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788309577.822794:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788309577.822798:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788309577.822817:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f46294c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.822829:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f46294c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.822849:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f46294b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.822855:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f46294b6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.822862:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f46294b6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.822868:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8d73ee400 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:3.0:1788309577.822873:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f46294b6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.822880:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f46294b6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.822892:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97c8d832f200) 00010000:00010000:3.0:1788309577.822895:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788309577.822899:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f46294b6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.822905:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f46294b6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.822919:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f46294bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.822925:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f46294bd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.822930:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f46294bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.822942:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8d73eee00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:3.0:1788309577.822945:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f46294bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.822952:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f46294bd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.822960:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97c8e2544900) 00010000:00010000:3.0:1788309577.822963:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788309577.822965:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f46294bd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.822971:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f46294bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.823004:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f46294af lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad18 expref: 61 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.823018:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f46294c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad18 expref: 60 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.823026:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97c8d83f4b00) 00010000:00010000:3.0:1788309577.823028:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788309577.823031:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8c153a000, rc 0) 00000100:00100000:3.0:1788309577.823084:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c958ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+60:11602:x1875178192724736:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 843us (1061us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309577.823091:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 211 00000100:00100000:1.0:1788309577.828959:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309577.829050:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192724992 00000100:00100000:2.0:1788309577.829060:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192724992 00000100:00100000:2.0:1788309577.829122:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 212 00000100:00100000:2.0:1788309577.829133:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8edf33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+60:11602:x1875178192724992:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:2.0:1788309577.829152:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309577.829182:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc935c00/0x63a04852f46294cb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ad1f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309577.829336:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934600/0x63a04852f46294d2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309577.829352:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934c00/0x63a04852f462949a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad0a expref: 61 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309577.829360:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f46294c4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad18 expref: 61 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309577.829368:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934600/0x63a04852f46294d2 lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309577.829404:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f46294c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad18 expref: 61 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309577.829418:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f46294c4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad18 expref: 61 pid: 5838 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309577.829429:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e6b4ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875178210537600:192.168.202.55@tcp:104: 00010000:00010000:2.0:1788309577.830150:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934c00/0x63a04852f462949a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad0a expref: 61 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309577.830162:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934c00/0x63a04852f462949a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad0a expref: 61 pid: 5837 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309577.830172:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e6b4f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875178210537728:192.168.202.55@tcp:104: 00000100:00100000:2.0:1788309577.830209:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8f51d7900 going to sleep for 11 seconds 00000100:00100000:0.0:1788309577.835077:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309577.835222:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192725120 00000100:00100000:2.0:1788309577.835232:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192725120 00010000:00010000:2.0:1788309577.835272:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f46294c4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad18 expref: 62 pid: 5838 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309577.835344:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 78 00000100:00100000:2.0:1788309577.835355:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c958d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+62:2352:x1875178192725120:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788309577.835372:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788309577.835379:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f46294c4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad18 expref: 62 pid: 5838 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309577.835393:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f46294c4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad18 expref: 62 pid: 5838 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309577.835417:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97c8d83f4b00) 00010000:00010000:2.0:1788309577.835423:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934600/0x63a04852f46294d2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309577.835431:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934600/0x63a04852f46294d2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309577.835451:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788309577.835513:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c958d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+62:2352:x1875178192725120:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 159us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309577.835520:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 78 00010000:00010000:3.0:1788309577.851607:0:5839:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.55@tcp) returned -22 from blocking AST (req@00000000227aa37b x1875178210537600) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f46294c4 lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad18 expref: 61 pid: 5838 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.851653:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f46294c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad18 expref: 61 pid: 5838 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309577.851673:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e6b4ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875178210537600:192.168.202.55@tcp:104: 00000100:00100000:3.0:1788309577.851690:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e6b4f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875178210537728:192.168.202.55@tcp:104: 00010000:00010000:3.0:1788309577.851717:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97c8d83f4b00) 00010000:00010000:3.0:1788309577.851723:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934600/0x63a04852f46294d2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.851732:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934600/0x63a04852f46294d2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.851741:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934600/0x63a04852f46294d2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309577.854607:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309577.854769:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192725248 00000100:00100000:0.0:1788309577.854780:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192725248 00010000:00010000:0.0:1788309577.854832:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934c00/0x63a04852f462949a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad0a expref: 61 pid: 5837 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309577.854882:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 79 00000100:00100000:0.0:1788309577.854911:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ec684700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+61:2350:x1875178192725248:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788309577.854930:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788309577.854938:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934c00/0x63a04852f462949a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad0a expref: 61 pid: 5837 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309577.854952:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934c00/0x63a04852f462949a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad0a expref: 61 pid: 5837 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309577.854978:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934c00/0x63a04852f462949a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad0a expref: 61 pid: 5837 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309577.854998:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97c8d83f4b00) 00010000:00010000:0.0:1788309577.855003:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934600/0x63a04852f46294d2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309577.855014:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934600/0x63a04852f46294d2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309577.855022:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934600/0x63a04852f46294d2 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309577.855062:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788309577.855126:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ec684700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+60:2350:x1875178192725248:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 217us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309577.855134:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 79 00010000:00010000:1.0:1788309577.856116:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934600/0x63a04852f46294d2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309577.856142:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934600/0x63a04852f46294d2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788309577.856162:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788309577.856920:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc935c00/0x63a04852f46294cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad1f expref: 61 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309577.856947:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934600/0x63a04852f46294d2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad1f expref: 60 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309577.856956:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97c8d83f4b00) 00010000:00010000:1.0:1788309577.856959:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788309577.856962:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8fc934600, rc 0) 00000100:00100000:1.0:1788309577.857029:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8edf33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+60:11602:x1875178192724992:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 27897us (28078us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1788309577.857043:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 212 00000100:00100000:1.0:1788309577.863939:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309577.864027:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192725504 00000100:00100000:2.0:1788309577.864045:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192725504 00000100:00100000:2.0:1788309577.864118:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 16 00000100:00100000:2.0:1788309577.864131:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ec685500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+60:11602:x1875178192725504:12345-192.168.202.55@tcp:103:lfs.0 00010000:00010000:2.0:1788309577.864146:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788309577.864181:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4629431 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146acf5 expref: 60 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309577.864204:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97c8d83f4b00) 00010000:00010000:2.0:1788309577.864210:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788309577.864271:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ec685500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+59:11602:x1875178192725504:12345-192.168.202.55@tcp:103:lfs.0 Request processed in 143us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309577.864315:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 16 00000100:00100000:2.0:1788309577.871774:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309577.872217:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192725632 00000100:00100000:1.0:1788309577.872229:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192725632 00000100:00100000:1.0:1788309577.872318:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 213 00000100:00100000:1.0:1788309577.872329:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6b4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+59:11602:x1875178192725632:12345-192.168.202.55@tcp:58:lfs.0 00010000:00010000:1.0:1788309577.872631:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548400/0x63a04852f46294e0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309577.872651:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548400/0x63a04852f46294e0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309577.872665:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548400/0x63a04852f46294e0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788309577.872890:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1788309577.873230:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6b4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+59:11602:x1875178192725632:12345-192.168.202.55@tcp:58:lfs.0 Request processed in 900us (1464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309577.873239:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 213 00000100:00100000:0.0:1788309577.888319:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309577.888813:0:8305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192725760 00000100:00100000:3.0:1788309577.888827:0:8305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192725760 00000100:00100000:3.0:1788309577.888900:0:8305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 214 00000100:00100000:3.0:1788309577.888914:0:8305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c958f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+59:11602:x1875178192725760:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:3.0:1788309577.888937:0:8305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309577.888964:0:8305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f46294e7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ad26 expref: -99 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.889039:0:8305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548400/0x63a04852f46294e0 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.889072:0:8305:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f46294e7 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad26 expref: 60 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.889096:0:8305:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548400/0x63a04852f46294e0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.889109:0:8305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f46294e7 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad26 expref: 60 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.889124:0:8305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97c8d83f4b00) 00010000:00010000:3.0:1788309577.889127:0:8305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788309577.889131:0:8305:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f46294e7 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad26 expref: 60 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309577.889139:0:8305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8c153a000, rc 0) 00000100:00100000:3.0:1788309577.889215:0:8305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c958f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+60:11602:x1875178192725760:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 305us (955us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309577.889223:0:8305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 214 00010000:00010000:3.0:1788309578.471193:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788309578.656611:0:11678:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788309578.656625:0:11678:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788309578.656705:0:11678:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1788309578.656823:0:11678:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788309578.656956:0:11678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8efc4d180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11678:1875178210537856:192.168.202.55@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788309578.657092:0:11678:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d6932e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788309578.663125:0:11678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8efc4d180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11678:1875178210537856:192.168.202.55@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788309578.663920:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309578.663987:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192725888 00000100:00100000:1.0:1788309578.663995:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192725888 00000100:00100000:1.0:1788309578.664075:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 215 00000100:00100000:1.0:1788309578.664086:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6b4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+60:11603:x1875178192725888:12345-192.168.202.55@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788309578.664119:0:5838:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788309578.664243:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6b4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+60:11603:x1875178192725888:12345-192.168.202.55@tcp:53:lhsmtool_posix.0 Request processed in 157us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309578.664251:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 215 00000100:00100000:0.0:1788309578.672499:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309578.672627:0:8305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192726016 00000100:00100000:3.0:1788309578.672642:0:8305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192726016 00000100:00100000:3.0:1788309578.672733:0:8305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 216 00000100:00100000:3.0:1788309578.672747:0:8305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8efc4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+60:11603:x1875178192726016:12345-192.168.202.55@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788309578.672837:0:8305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f46294ee lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.672855:0:8305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f46294ee lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.672880:0:8305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f46294ee lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.672935:0:8305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f46294f5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.672943:0:8305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f46294f5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.672950:0:8305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f46294f5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.672974:0:8305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f46294fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.672982:0:8305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f46294fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.672988:0:8305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f46294fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788309578.673031:0:8305:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788309578.673035:0:8305:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788309578.673048:0:8305:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f46294fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.673058:0:8305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f46294ee lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.673065:0:8305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f46294ee lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.673082:0:8305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f46294ee lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.673088:0:8305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8c153a200 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:3.0:1788309578.673092:0:8305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f46294ee lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.673100:0:8305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f46294ee lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.673114:0:8305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97c8c2ab9600) 00010000:00010000:3.0:1788309578.673116:0:8305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788309578.673121:0:8305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f46294ee lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.673126:0:8305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f46294ee lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.673142:0:8305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f46294f5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.673147:0:8305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f46294f5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.673152:0:8305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f46294f5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.673156:0:8305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8c153ac00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:3.0:1788309578.673158:0:8305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f46294f5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.673185:0:8305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f46294f5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.673193:0:8305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff97c8e2544900) 00010000:00010000:3.0:1788309578.673195:0:8305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788309578.673198:0:8305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f46294f5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.673203:0:8305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f46294f5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.673226:0:8305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f46294fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.673233:0:8305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f46294fc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.673238:0:8305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f46294fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.673243:0:8305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8c153bc00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:3.0:1788309578.673245:0:8305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f46294fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.673251:0:8305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f46294fc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.673258:0:8305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97c8d83f4b00) 00010000:00010000:3.0:1788309578.673260:0:8305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788309578.673263:0:8305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f46294fc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.673750:0:8305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f46294fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309578.673892:0:8305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8efc4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+60:11603:x1875178192726016:12345-192.168.202.55@tcp:34:lhsmtool_posix.0 Request processed in 1146us (1575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309578.673902:0:8305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 216 00000100:00100000:3.0:1788309578.684061:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309578.684161:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192726272 00000100:00100000:1.0:1788309578.684184:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192726272 00000100:00100000:1.0:1788309578.684262:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 217 00000100:00100000:1.0:1788309578.684310:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6587100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+60:11603:x1875178192726272:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788309578.684341:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788309578.684364:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549200/0x63a04852f4629503 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ad2d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309578.684460:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f462950a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309578.684477:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f462950a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309578.684502:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f462950a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788309578.684515:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788309578.684622:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f462950a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309578.684629:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f462950a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309578.684636:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f462950a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309578.684642:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8f5548800 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:1.0:1788309578.684647:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f462950a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309578.684886:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f462950a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309578.684900:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97c8d83f4b00) 00010000:00010000:1.0:1788309578.684903:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788309578.684908:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f462950a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309578.684914:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f462950a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309578.684959:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549200/0x63a04852f4629503 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad2d expref: 62 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309578.684982:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97c8c2ab9600) 00010000:00010000:1.0:1788309578.684984:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788309578.684989:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549200/0x63a04852f4629503 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad2d expref: 62 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309578.685000:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8f5549200, rc 0) 00000100:00100000:1.0:1788309578.685065:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6587100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+61:11603:x1875178192726272:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 793us (1013us total) trans 4294967503 rc 301/301 00000100:00100000:1.0:1788309578.685073:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 217 00000100:00100000:2.0:1788309578.689964:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309578.690039:0:8305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192726400 00000100:00100000:3.0:1788309578.690049:0:8305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192726400 00000100:00100000:3.0:1788309578.690099:0:8305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 218 00000100:00100000:3.0:1788309578.690109:0:8305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+61:11603:x1875178192726400:12345-192.168.202.55@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788309578.690141:0:8305:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788309578.690257:0:8305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+61:11603:x1875178192726400:12345-192.168.202.55@tcp:53:lhsmtool_posix.0 Request processed in 149us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309578.690264:0:8305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 218 00000100:00100000:0.0:1788309578.698698:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309578.698902:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192726656 00000100:00100000:1.0:1788309578.698914:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192726656 00000100:00100000:1.0:1788309578.698980:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 219 00000100:00100000:1.0:1788309578.698992:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8efc4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+61:11603:x1875178192726656:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788309578.699013:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788309578.699017:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788309578.701055:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e800/0x63a04852f46294a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad11 expref: 61 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309578.701082:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97c8d832f200) 00010000:00010000:1.0:1788309578.701088:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788309578.701122:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549200/0x63a04852f4629518 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ad34 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788309578.704449:0:5838:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:1.0:1788309578.704699:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f462951f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309578.704733:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f462951f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309578.704745:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f462951f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309578.704823:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549200/0x63a04852f4629518 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad34 expref: 63 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309578.704844:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f462951f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad34 expref: 62 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309578.704854:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97c8d832fa00) 00010000:00010000:1.0:1788309578.704857:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788309578.704861:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8f5548800, rc 0) 00000100:00100000:1.0:1788309578.704943:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8efc4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+62:11603:x1875178192726656:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 5953us (6257us total) trans 4294967504 rc 0/0 00000100:00100000:1.0:1788309578.704952:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 219 00000100:00100000:0.0:1788309578.713003:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309578.713135:0:8305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192726912 00000100:00100000:3.0:1788309578.713146:0:8305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192726912 00000100:00100000:3.0:1788309578.713223:0:8305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 220 00000100:00100000:3.0:1788309578.713234:0:8305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8efc4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+62:11603:x1875178192726912:12345-192.168.202.55@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788309578.713332:0:8305:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788309578.713359:0:8305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f462951f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad34 expref: 62 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.713379:0:8305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97c8d832fa00) 00010000:00010000:3.0:1788309578.713388:0:8305:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788309578.713422:0:8305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f462952d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.713436:0:8305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f462952d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.713445:0:8305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f462952d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.713508:0:8305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4629534 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xf6daea25 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.713516:0:8305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4629534 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xf6daea25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.713532:0:8305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4629534 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xf6daea25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.713609:0:8305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f462952d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.713616:0:8305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f462952d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.713622:0:8305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f462952d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.713628:0:8305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8c153bc00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:3.0:1788309578.713633:0:8305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f462952d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.713645:0:8305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f462952d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.713663:0:8305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97c8d832f200) 00010000:00010000:3.0:1788309578.713665:0:8305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788309578.713669:0:8305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f462952d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.713675:0:8305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153bc00/0x63a04852f462952d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.713685:0:8305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4629534 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xf6daea25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.713689:0:8305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4629534 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf6daea25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.713694:0:8305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4629534 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf6daea25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.713699:0:8305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8c153ac00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:3.0:1788309578.713701:0:8305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4629534 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf6daea25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.713707:0:8305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4629534 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf6daea25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.713713:0:8305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xf6daea25 (ffff97c8e2544900) 00010000:00010000:3.0:1788309578.713716:0:8305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788309578.713718:0:8305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4629534 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xf6daea25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.713724:0:8305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f4629534 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xf6daea25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309578.713815:0:8305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8efc4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+61:11603:x1875178192726912:12345-192.168.202.55@tcp:36:lhsmtool_posix.0 Request processed in 581us (824us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788309578.713824:0:8305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 220 00000100:00100000:2.0:1788309578.718621:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309578.718808:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192727040 00000100:00100000:3.0:1788309578.718819:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192727040 00000100:00100000:3.0:1788309578.718896:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 221 00000100:00100000:3.0:1788309578.718907:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+61:11603:x1875178192727040:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788309578.718927:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309578.718961:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f462953b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ad3b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.718999:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f4629542 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.719013:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f4629542 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.719025:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f4629542 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.719130:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f462953b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad3b expref: 63 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.719151:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f4629542 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad3b expref: 62 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.719160:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97c8e2544100) 00010000:00010000:3.0:1788309578.719181:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788309578.719185:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8d73ef800, rc 0) 00000100:00100000:3.0:1788309578.719765:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+62:11603:x1875178192727040:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 856us (1153us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309578.719773:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 221 00000100:00100000:2.0:1788309578.734804:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309578.735266:0:8305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192727296 00000100:00100000:3.0:1788309578.735320:0:8305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192727296 00000100:00100000:3.0:1788309578.735397:0:8305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 222 00000100:00100000:3.0:1788309578.735411:0:8305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6b4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+62:11603:x1875178192727296:12345-192.168.202.55@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788309578.735748:0:8305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4629549 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.735773:0:8305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4629549 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.735789:0:8305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4629549 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788309578.736118:0:8305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:3.0:1788309578.736131:0:8305:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 341486852788ns, next at 342486848805ns, rc = 0 00000004:00010000:3.0:1788309578.738016:0:8305:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006f7e6bce reply state 000000003ff616d2 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4629549 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309578.738037:0:8305:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788309578.756326:0:8305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6b4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+64:11603:x1875178192727296:12345-192.168.202.55@tcp:36:lhsmtool_posix.0 Request processed in 20903us (21521us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1788309578.756341:0:8305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 222 00010000:00010000:3.0:1788309578.771639:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4629549 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.771659:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4629549 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.771667:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4629549 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.771692:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8d73eee00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:3.0:1788309578.771698:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4629549 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.771706:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4629549 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.771725:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97c8e2544100) 00010000:00010000:3.0:1788309578.771728:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788309578.771733:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4629549 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.771751:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4629549 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309578.772456:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309578.772678:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192727424 00000100:00100000:3.0:1788309578.772689:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192727424 00000100:00100000:3.0:1788309578.772764:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 223 00000100:00100000:3.0:1788309578.772776:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6b4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+63:11603:x1875178192727424:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788309578.772802:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309578.772834:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f4629550 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ad42 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.772906:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f4629550 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad42 expref: 64 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.772919:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f4629550 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad42 expref: 64 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.772954:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97c8e2544100) 00010000:00010000:3.0:1788309578.772957:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788309578.772960:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8d73ee400, rc 0) 00000100:00100000:3.0:1788309578.773014:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6b4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+64:11603:x1875178192727424:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 239us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309578.773021:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 223 00000100:00100000:1.0:1788309578.782199:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309578.785518:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192727552 00000100:00100000:0.0:1788309578.785536:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192727552 00000100:00100000:0.0:1788309578.785684:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 62 00000100:00100000:0.0:1788309578.785699:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ec685880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+9:2352:x1875178192727552:12345-192.168.202.55@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1788309578.785985:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788309578.787273:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ec685880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+10:2352:x1875178192727552:12345-192.168.202.55@tcp:2:lhsmtool_posix.0 Request processed in 1572us (5082us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1788309578.787308:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 62 00000100:00100000:0.0:1788309578.794402:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309578.796587:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192727808 00000100:00100000:1.0:1788309578.796605:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192727808 00000100:00100000:1.0:1788309578.796764:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 60 00000100:00100000:1.0:1788309578.796778:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8efc4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+64:11603:x1875178192727808:12345-192.168.202.55@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788309578.797058:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8efc4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+65:11603:x1875178192727808:12345-192.168.202.55@tcp:35:lhsmtool_posix.0 Request processed in 283us (2782us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1788309578.797067:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 60 00000100:00100000:2.0:1788309578.805124:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309578.805317:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192728064 00000100:00100000:0.0:1788309578.805329:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192728064 00000100:00100000:0.0:1788309578.805393:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 224 00000100:00100000:0.0:1788309578.805405:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+65:11603:x1875178192728064:12345-192.168.202.55@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788309578.805684:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+65:11603:x1875178192728064:12345-192.168.202.55@tcp:57:lhsmtool_posix.0 Request processed in 279us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309578.805693:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 224 00000100:00100000:2.0:1788309578.812798:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309578.812969:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192728192 00000100:00100000:3.0:1788309578.812981:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192728192 00000100:00100000:3.0:1788309578.813044:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 225 00000100:00100000:3.0:1788309578.813055:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc76bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+65:11603:x1875178192728192:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788309578.813076:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309578.813098:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4629557 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ad49 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.813178:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f462955e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.813193:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f462955e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.813205:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f462955e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788309578.813243:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788309578.813262:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f462955e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.813330:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4629557 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad49 expref: 67 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.813351:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f462955e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad49 expref: 66 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.813361:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97c8e2544100) 00010000:00010000:3.0:1788309578.813364:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788309578.813368:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8c153a200, rc 0) 00000100:00100000:3.0:1788309578.813430:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc76bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+66:11603:x1875178192728192:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 377us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309578.813438:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 225 00000100:00100000:2.0:1788309578.823077:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309578.825139:0:12478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192728320 00000100:00100000:3.0:1788309578.825153:0:12478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192728320 00000100:00100000:3.0:1788309578.825230:0:12478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 63 00000100:00100000:3.0:1788309578.825241:0:12478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc768a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+10:2350:x1875178192728320:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788309578.825260:0:12478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309578.825330:0:12478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eaffa74f/0x63a04852f4629565 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ad50 expref: -99 pid: 12478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788309578.825362:0:12478:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a97704a, blocks: 0x1 00010000:00010000:3.0:1788309578.825393:0:12478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=341s v=(0 0) 00010000:00010000:3.0:1788309578.825398:0:12478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788309578.825410:0:12478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eaffa74f/0x63a04852f4629565 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad50 expref: 11 pid: 12478 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.825450:0:12478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000eaffa74f/0x63a04852f4629565 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad50 expref: 11 pid: 12478 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.825464:0:12478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8c153ac00, rc 0) 00000100:00100000:0.0:1788309578.825772:0:12478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc768a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+11:2350:x1875178192728320:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 530us (2703us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309578.825781:0:12478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 63 00000100:00100000:0.0:1788309578.848410:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309578.861410:0:8305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192728576 00000100:00100000:2.0:1788309578.861427:0:8305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192728576 00000100:00100000:2.0:1788309578.861514:0:8305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 226 00000100:00100000:2.0:1788309578.861526:0:8305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8efc4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+66:11603:x1875178192728576:12345-192.168.202.55@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788309578.861680:0:8305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8efc4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+66:11603:x1875178192728576:12345-192.168.202.55@tcp:57:lhsmtool_posix.0 Request processed in 156us (13279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309578.861688:0:8305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 226 00000100:00100000:1.0:1788309578.866379:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309578.872237:0:10673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192728704 00000100:00100000:2.0:1788309578.872253:0:10673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192728704 00000100:00100000:2.0:1788309578.872376:0:10673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 64 00000100:00100000:2.0:1788309578.872387:0:10673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc501050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+11:11603:x1875178192728704:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788309578.872407:0:10673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309578.872431:0:10673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9f6cacf/0x63a04852f462956c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ad57 expref: -99 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309578.872476:0:10673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000eaffa74f/0x63a04852f4629565 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad50 expref: 12 pid: 12478 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309578.872484:0:10673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788309578.872488:0:10673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788309578.872502:0:10673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9f6cacf/0x63a04852f462956c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad57 expref: 12 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309578.872559:0:10673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000eaffa74f/0x63a04852f4629565 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad50 expref: 12 pid: 12478 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309578.872574:0:10673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000eaffa74f/0x63a04852f4629565 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad50 expref: 12 pid: 12478 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309578.872590:0:10673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc76b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10673:1875178210537984:192.168.202.55@tcp:104: 00000100:00100000:2.0:1788309578.872711:0:10673:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8f51d7540 going to sleep for 11 seconds 00000100:00100000:2.0:1788309578.875964:0:10673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc76b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10673:1875178210537984:192.168.202.55@tcp:104: 00010000:00010000:2.0:1788309578.876014:0:10673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e9f6cacf/0x63a04852f462956c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad57 expref: 12 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309578.877322:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309578.877420:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192728832 00000100:00100000:0.0:1788309578.877448:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192728832 00010000:00010000:0.0:1788309578.877528:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000eaffa74f/0x63a04852f4629565 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad50 expref: 13 pid: 12478 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309578.877580:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 80 00000100:00100000:0.0:1788309578.877591:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6b2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+13:2350:x1875178192728832:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788309578.877611:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788309578.877636:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000eaffa74f/0x63a04852f4629565 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad50 expref: 13 pid: 12478 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309578.877651:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000eaffa74f/0x63a04852f4629565 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad50 expref: 13 pid: 12478 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309578.877673:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eaffa74f/0x63a04852f4629565 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad50 expref: 13 pid: 12478 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309578.877692:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788309578.877697:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788309578.877705:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e9f6cacf/0x63a04852f462956c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad57 expref: 12 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309578.877715:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9f6cacf/0x63a04852f462956c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad57 expref: 12 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309578.877751:0:5821:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e9f6cacf/0x63a04852f462956c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad57 expref: 12 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309578.877777:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecfd1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5821:1875178210538112:192.168.202.55@tcp:105: 00000100:00100000:0.0:1788309578.877856:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d6932180 going to sleep for 11 seconds 00010000:00010000:2.0:1788309578.879397:0:10673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8fc934800, rc 0) 00000100:00100000:0.0:1788309578.879548:0:10673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc501050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+12:11603:x1875178192728704:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 7159us (13177us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309578.879557:0:10673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 64 00000100:00100000:1.0:1788309578.888338:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309578.888737:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecfd1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5821:1875178210538112:192.168.202.55@tcp:105: 00010000:00010000:0.0:1788309578.888764:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788309578.888835:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6b2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+11:2350:x1875178192728832:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 11245us (11567us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309578.888849:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 80 00000100:00100000:3.0:1788309578.889060:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192728960 00000100:00100000:3.0:1788309578.889069:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192728960 00002000:00100000:3.0:1788309578.889120:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff97c8ec687800 x1875178192728960/t0(0) o4->86451057-f8bb-4d7c-a7c2-5c834b43e3d3@192.168.202.55@tcp:734/0 lens 504/0 e 0 to 0 dl 1788309589 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788309578.889132:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97c8ec687800 with x1875178192728960 ext(0->12) 00002000:00010000:3.0:1788309578.889137:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97c8ec687800 00000100:00100000:3.0:1788309578.889180:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 6 00000100:00100000:3.0:1788309578.889191:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ec687800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+11:2350:x1875178192728960:12345-192.168.202.55@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788309578.890192:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ec687800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+13:2350:x1875178192728960:12345-192.168.202.55@tcp:4:lhsmtool_posix.0 Request processed in 998us (1858us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1788309578.890201:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 6 00002000:00100000:3.0:1788309578.890209:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff97c8ec687800 x1875178192728960/t4294967320(0) o4->86451057-f8bb-4d7c-a7c2-5c834b43e3d3@192.168.202.55@tcp:734/0 lens 504/448 e 0 to 0 dl 1788309589 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788309578.890218:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97c8ec687800 with x1875178192728960 ext(0->12) 00002000:00010000:3.0:1788309578.890222:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97c8ec687800 00000100:00100000:3.0:1788309578.899192:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309578.899757:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192729088 00000100:00100000:1.0:1788309578.899770:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192729088 00000100:00100000:1.0:1788309578.899842:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 227 00000100:00100000:1.0:1788309578.899853:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6584700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+66:11603:x1875178192729088:12345-192.168.202.55@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788309578.964471:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:1.0:1788309578.964519:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:1.0:1788309578.964541:0:5859:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff97c8e6bc16c0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1788309578.964618:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97c8ffbb4c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff97c8e6bc1780 00000020:00080000:1.0:1788309578.964621:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97c8ffbb4000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff97c8d6a3e000 00000020:00080000:1.0:1788309578.964651:0:5859:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000004:00080000:1.0:1788309578.964674:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:1.0:1788309578.964700:0:5859:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff97c8f51d7240 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1788309578.964703:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97c8e0659d00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff97c8f51d7840 00000020:00080000:1.0:1788309578.964706:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97c8e0659800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff97c8efc3a000 00000004:00080000:1.0:1788309578.964723:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000020:00080000:1.0:1788309578.964767:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1788309578.964993:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1788309578.965504:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788309578.965540:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e6584000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210538240:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788309578.965751:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788309578.965796:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ec685500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875178210538496:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788309578.965860:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309578.965925:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210538496 00000100:00100000:1.0:1788309578.965932:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210538496 00000100:00100000:1.0:1788309578.965992:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788309578.966002:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ec686680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3302:x1875178210538496:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788309578.966314:0:6681:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788309578.966319:0:6681:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788309578 00002000:00010000:1.0:1788309578.966321:0:6681:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788309578.966324:0:6681:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1788309578 -> 1788309578 00002000:00010000:1.0:1788309578.966326:0:6681:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788309578.966423:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ec686680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3302:x1875178210538496:12345-0@lo:2:osp-syn-1-0.0 Request processed in 363us (503us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1788309578.966432:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:1.0:1788309578.966454:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1788309578.966487:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97c8ec685500/2, rc 0, transno 4294967321 00000100:00100000:1.0:1788309578.966494:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ec685500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875178210538496:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788309578.966695:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309578.966825:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6584700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+20:11603:x1875178192729088:12345-192.168.202.55@tcp:44:lhsmtool_posix.0 Request processed in 66972us (67642us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309578.966834:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 227 00000100:00100000:3.0:1788309578.967788:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210538240 00000100:00100000:3.0:1788309578.967797:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210538240 00000100:00100000:3.0:1788309578.967844:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788309578.967853:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6979180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3301:x1875178210538240:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788309578.967874:0:6682:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:3.0:1788309578.967906:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a977048, atime: 0x6a977049, ctime: 0x6a977048, blocks: 0x1 00010000:00010000:3.0:1788309578.967913:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eaffa74f/0x63a04852f4629573 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.967929:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=341s v=(0 0) 00010000:00010000:3.0:1788309578.967933:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788309578.967940:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eaffa74f/0x63a04852f4629573 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.967956:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eaffa74f/0x63a04852f4629573 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.967966:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eaffa74f/0x63a04852f4629573 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.967973:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eaffa74f/0x63a04852f4629573 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.967991:0:6682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788309578.969730:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6979180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3301:x1875178210538240:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1873us (3029us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788309578.969741:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00010000:3.0:1788309578.969777:0:7628:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788309578.969787:0:7628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eaffa74f/0x63a04852f4629573 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.969799:0:7628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8c153ac00 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:3.0:1788309578.969805:0:7628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eaffa74f/0x63a04852f4629573 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.969816:0:7628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eaffa74f/0x63a04852f4629573 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.969838:0:7628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eaffa74f/0x63a04852f4629573 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.969845:0:7628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eaffa74f/0x63a04852f4629573 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.969867:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309578.969868:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309578.969870:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788309578.970052:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ec684700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210538368:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788309578.970095:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788309578.970477:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97c8e6584000/2, rc 0, transno 4294967310 00000100:00100000:1.0:1788309578.970485:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e6584000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210538240:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788309578.970737:0:10673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210538368 00000100:00100000:0.0:1788309578.970744:0:10673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210538368 00000100:00100000:0.0:1788309578.970872:0:10673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788309578.970882:0:10673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc76b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3300:x1875178210538368:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788309578.970909:0:10673:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:0.0:1788309578.970932:0:10673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d88ce9a/0x63a04852f462957a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309578.970952:0:10673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bda9db79/0x63a04852f4629335 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146acb6 expref: 12 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309578.970959:0:10673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1788309578.970963:0:10673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788309578.970968:0:10673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d88ce9a/0x63a04852f462957a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309578.971012:0:10673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bda9db79/0x63a04852f4629335 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146acb6 expref: 12 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309578.971038:0:10673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bda9db79/0x63a04852f4629335 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146acb6 expref: 12 pid: 10673 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309578.971051:0:10673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecfd1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10673:1875178210538624:192.168.202.55@tcp:104: 00000100:00100000:0.0:1788309578.971244:0:10673:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d6932b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788309578.971531:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309578.971975:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192729216 00000100:00100000:1.0:1788309578.971981:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192729216 00000100:00100000:1.0:1788309578.972061:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 68 00000100:00100000:1.0:1788309578.972069:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e697bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+13:2351:x1875178192729216:12345-192.168.202.55@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788309578.976706:0:10673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecfd1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10673:1875178210538624:192.168.202.55@tcp:104: 00010000:00010000:0.0:1788309578.976738:0:10673:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007d88ce9a/0x63a04852f462957a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309578.978534:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309578.978852:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192729344 00000100:00100000:3.0:1788309578.978861:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192729344 00010000:00010000:3.0:1788309578.978898:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bda9db79/0x63a04852f4629335 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146acb6 expref: 14 pid: 10673 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309578.979496:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 81 00000100:00100000:3.0:1788309578.979508:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc768e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+14:2350:x1875178192729344:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788309578.979606:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788309578.979615:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bda9db79/0x63a04852f4629335 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146acb6 expref: 14 pid: 10673 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.979631:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bda9db79/0x63a04852f4629335 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146acb6 expref: 14 pid: 10673 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.979654:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bda9db79/0x63a04852f4629335 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146acb6 expref: 14 pid: 10673 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.979672:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788309578.979677:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788309578.979683:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007d88ce9a/0x63a04852f462957a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.979694:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d88ce9a/0x63a04852f462957a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.979723:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788309578.979770:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc768e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+13:2350:x1875178192729344:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 265us (1245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309578.979778:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 81 00010000:00010000:0.0:1788309578.982857:0:10673:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007d88ce9a/0x63a04852f462957a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309578.982877:0:10673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d88ce9a/0x63a04852f462957a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309578.982890:0:10673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d88ce9a/0x63a04852f462957a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309578.982897:0:10673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d88ce9a/0x63a04852f462957a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309578.982929:0:10673:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788309578.983764:0:10673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc76b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3300:x1875178210538368:12345-0@lo:6:osp-syn-1-0.0 Request processed in 12878us (13661us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1788309578.983775:0:10673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00010000:0.0:1788309578.984529:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788309578.984540:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d88ce9a/0x63a04852f462957a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309578.984562:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8ecf2f000 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:0.0:1788309578.984567:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d88ce9a/0x63a04852f462957a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309578.984578:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d88ce9a/0x63a04852f462957a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309578.984602:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d88ce9a/0x63a04852f462957a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309578.984610:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d88ce9a/0x63a04852f462957a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309578.984636:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309578.984638:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309578.984640:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788309578.986200:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97c8ec684700/2, rc 0, transno 4294967322 00000100:00100000:2.0:1788309578.986214:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ec684700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210538368:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788309579.015937:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e697bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+12:2351:x1875178192729216:12345-192.168.202.55@tcp:16:lhsmtool_posix.0 Request processed in 43856us (44395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309579.015966:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 68 00000001:00080000:3.0:1788309579.016202:0:7639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967319 is committed 00000001:00080000:3.0:1788309579.016215:0:7639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967317 is committed 00000001:00080000:3.0:1788309579.016223:0:7639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:3.0:1788309579.016250:0:7639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000100:00100000:2.0:1788309579.019181:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309579.019317:0:8305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192729600 00000100:00100000:0.0:1788309579.019328:0:8305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192729600 00000100:00080000:1.0:1788309579.019450:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788309579.019491:0:8305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 228 00000100:00100000:0.0:1788309579.019505:0:8305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+20:11603:x1875178192729600:12345-192.168.202.55@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788309579.019571:0:8305:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788309579.019605:0:8305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a200/0x63a04852f462955e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad49 expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309579.019626:0:8305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97c8e2544100) 00010000:00010000:0.0:1788309579.019631:0:8305:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788309579.019673:0:8305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f000/0x63a04852f4629581 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309579.019694:0:8305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f000/0x63a04852f4629581 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309579.019704:0:8305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f000/0x63a04852f4629581 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788309579.020273:0:8305:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000d5a2369 reply state 00000000f90d7320 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f000/0x63a04852f4629581 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309579.020327:0:8305:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788309579.020568:0:8305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+21:11603:x1875178192729600:12345-192.168.202.55@tcp:36:lhsmtool_posix.0 Request processed in 1065us (1549us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1788309579.020577:0:8305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 228 00010000:00010000:0.0:1788309579.022812:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f000/0x63a04852f4629581 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309579.022850:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f000/0x63a04852f4629581 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309579.022858:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f000/0x63a04852f4629581 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309579.022863:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8ecf2f000 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:0.0:1788309579.022874:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f000/0x63a04852f4629581 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309579.022882:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f000/0x63a04852f4629581 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309579.022906:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97c8e2544100) 00010000:00010000:0.0:1788309579.022910:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788309579.022915:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f000/0x63a04852f4629581 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309579.022926:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f000/0x63a04852f4629581 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309579.024891:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309579.026644:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192729728 00000100:00100000:3.0:1788309579.026658:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192729728 00000100:00100000:3.0:1788309579.026770:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 69 00000100:00100000:3.0:1788309579.026782:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f5243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+7:2350:x1875178192729728:12345-192.168.202.55@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788309579.027015:0:6682:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1788309579.027019:0:6682:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1788309578 -> 1788309577 00002000:00010000:3.0:1788309579.027028:0:6682:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788309577 00002000:00010000:3.0:1788309579.027031:0:6682:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1788309578 -> 1788309577 00002000:00010000:3.0:1788309579.027033:0:6682:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788309579.027100:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f5243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+8:2350:x1875178192729728:12345-192.168.202.55@tcp:2:lhsmtool_posix.0 Request processed in 319us (2218us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1788309579.027108:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 69 00000100:00100000:1.0:1788309579.030235:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309579.030329:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192729984 00000100:00100000:2.0:1788309579.030340:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192729984 00000100:00100000:2.0:1788309579.030415:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 229 00000100:00100000:2.0:1788309579.030451:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ec685880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+20:11603:x1875178192729984:12345-192.168.202.55@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788309579.030547:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934e00/0x63a04852f4629588 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309579.030565:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f4629542 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad3b expref: 20 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309579.030576:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934e00/0x63a04852f4629588 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309579.030612:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f4629542 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad3b expref: 20 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309579.030627:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f4629542 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad3b expref: 20 pid: 5837 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309579.030645:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8f5240700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1875178210538752:192.168.202.55@tcp:104: 00000100:00100000:2.0:1788309579.030829:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8f51d7f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788309579.038634:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8f5240700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1875178210538752:192.168.202.55@tcp:104: 00010000:00010000:2.0:1788309579.038667:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934e00/0x63a04852f4629588 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309579.043254:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309579.044764:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192730112 00000100:00100000:3.0:1788309579.044776:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192730112 00010000:00010000:3.0:1788309579.044857:0:8447:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f4629542 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad3b expref: 21 pid: 5837 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309579.044943:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 82 00000100:00100000:3.0:1788309579.044954:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8eff0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+21:2350:x1875178192730112:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788309579.044969:0:8447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788309579.044977:0:8447:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f4629542 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad3b expref: 21 pid: 5837 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309579.045002:0:8447:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f4629542 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad3b expref: 21 pid: 5837 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309579.045037:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f4629542 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad3b expref: 21 pid: 5837 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309579.045081:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97c8e2544100) 00010000:00010000:3.0:1788309579.045087:0:8447:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934e00/0x63a04852f4629588 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309579.045097:0:8447:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934e00/0x63a04852f4629588 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309579.045106:0:8447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934e00/0x63a04852f4629588 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309579.045149:0:8447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788309579.045233:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8eff0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+20:2350:x1875178192730112:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 280us (1988us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309579.045241:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 82 00010000:00010000:2.0:1788309579.045315:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934e00/0x63a04852f4629588 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309579.045325:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934e00/0x63a04852f4629588 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309579.045354:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934e00/0x63a04852f4629588 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309579.045368:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934e00/0x63a04852f4629588 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309579.045375:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934e00/0x63a04852f4629588 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309579.045382:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8fc934e00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309579.045386:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934e00/0x63a04852f4629588 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309579.045394:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934e00/0x63a04852f4629588 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309579.045404:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97c8e2544100) 00010000:00010000:2.0:1788309579.045407:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788309579.045410:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934e00/0x63a04852f4629588 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309579.045417:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934e00/0x63a04852f4629588 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309579.045461:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ec685880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+19:11603:x1875178192729984:12345-192.168.202.55@tcp:55:lhsmtool_posix.0 Request processed in 15012us (15235us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788309579.045469:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 229 00000100:00100000:0.0:1788309579.049930:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309579.050003:0:12478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192730240 00000100:00100000:1.0:1788309579.050013:0:12478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192730240 00000100:00100000:1.0:1788309579.050072:0:12478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 70 00000100:00100000:1.0:1788309579.050098:0:12478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecfd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+8:2351:x1875178192730240:12345-192.168.202.55@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788309579.050145:0:12478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000eae37608/0x63a04852f462958f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309579.050176:0:12478:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e9f6cacf/0x63a04852f462956c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad57 expref: 8 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309579.050185:0:12478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788309579.050189:0:12478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788309579.050195:0:12478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eae37608/0x63a04852f462958f lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309579.050230:0:12478:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e9f6cacf/0x63a04852f462956c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad57 expref: 8 pid: 10673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309579.050244:0:12478:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e9f6cacf/0x63a04852f462956c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad57 expref: 8 pid: 10673 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309579.050259:0:12478:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12478:1875178210538880:192.168.202.55@tcp:104: 00000100:00100000:1.0:1788309579.050368:0:12478:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8eff1ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1788309579.053536:0:12478:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12478:1875178210538880:192.168.202.55@tcp:104: 00010000:00010000:2.0:1788309579.053568:0:12478:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000eae37608/0x63a04852f462958f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309579.055876:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309579.056182:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192730368 00000100:00100000:3.0:1788309579.056193:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192730368 00010000:00010000:3.0:1788309579.056242:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e9f6cacf/0x63a04852f462956c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad57 expref: 9 pid: 10673 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309579.056336:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 83 00000100:00100000:3.0:1788309579.056349:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecfd2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+9:2350:x1875178192730368:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788309579.056427:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788309579.056453:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e9f6cacf/0x63a04852f462956c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad57 expref: 9 pid: 10673 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309579.056468:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e9f6cacf/0x63a04852f462956c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad57 expref: 9 pid: 10673 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309579.056671:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9f6cacf/0x63a04852f462956c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad57 expref: 9 pid: 10673 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309579.056687:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788309579.056691:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788309579.056697:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eae37608/0x63a04852f462958f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309579.056706:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eae37608/0x63a04852f462958f lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309579.056850:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788309579.057022:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecfd2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+8:2350:x1875178192730368:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 674us (1156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309579.057031:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 83 00010000:00010000:1.0:1788309579.059053:0:12478:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000eae37608/0x63a04852f462958f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309579.059074:0:12478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eae37608/0x63a04852f462958f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309579.059134:0:12478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000eae37608/0x63a04852f462958f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309579.059143:0:12478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eae37608/0x63a04852f462958f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309579.059152:0:12478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eae37608/0x63a04852f462958f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309579.059159:0:12478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8f5548e00 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:1.0:1788309579.059252:0:12478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eae37608/0x63a04852f462958f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309579.059263:0:12478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eae37608/0x63a04852f462958f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309579.059467:0:12478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eae37608/0x63a04852f462958f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309579.059707:0:12478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eae37608/0x63a04852f462958f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309579.059871:0:12478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecfd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+7:2351:x1875178192730240:12345-192.168.202.55@tcp:1:lhsmtool_posix.0 Request processed in 9771us (9945us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309579.059882:0:12478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 70 00000100:00100000:0.0:1788309579.063748:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309579.063879:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192730624 00000100:00100000:2.0:1788309579.063907:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192730624 00000100:00100000:2.0:1788309579.064014:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 230 00000100:00100000:2.0:1788309579.064026:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecf15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+19:11603:x1875178192730624:12345-192.168.202.55@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788309579.064109:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934e00/0x63a04852f4629596 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309579.064126:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934e00/0x63a04852f4629596 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309579.064137:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934e00/0x63a04852f4629596 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309579.064649:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc935400/0x63a04852f462959d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309579.064662:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f4629550 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad42 expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309579.064671:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc935400/0x63a04852f462959d lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309579.064708:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f4629550 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad42 expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309579.064720:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f4629550 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad42 expref: 20 pid: 5838 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309579.064733:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8f5240700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875178210539008:192.168.202.55@tcp:104: 00000100:00100000:2.0:1788309579.064821:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8f51d7f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788309579.072582:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8f5240700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875178210539008:192.168.202.55@tcp:104: 00010000:00010000:3.0:1788309579.072614:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc935400/0x63a04852f462959d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309579.073038:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309579.073751:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192730752 00000100:00100000:3.0:1788309579.073761:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192730752 00010000:00010000:3.0:1788309579.073805:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f4629550 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad42 expref: 21 pid: 5838 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309579.073886:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 84 00000100:00100000:3.0:1788309579.073897:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8eff0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+21:2350:x1875178192730752:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788309579.073911:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788309579.073919:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f4629550 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad42 expref: 21 pid: 5838 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309579.073947:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f4629550 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad42 expref: 21 pid: 5838 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309579.073969:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f4629550 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad42 expref: 21 pid: 5838 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309579.073996:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97c8e2544100) 00010000:00010000:3.0:1788309579.074001:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc935400/0x63a04852f462959d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309579.074010:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc935400/0x63a04852f462959d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309579.074017:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc935400/0x63a04852f462959d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309579.074045:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788309579.074099:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8eff0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+20:2350:x1875178192730752:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 205us (1063us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309579.074107:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 84 00010000:00010000:1.0:1788309579.074154:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc935400/0x63a04852f462959d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309579.074172:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc935400/0x63a04852f462959d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788309579.074434:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:1.0:1788309579.074844:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:1.0:1788309579.074893:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:1.0:1788309579.074996:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5839:1875178210539136:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788309579.075079:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309579.075114:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8eff1e780 going to sleep for 11 seconds 00000100:00100000:1.0:1788309579.075141:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210539136 00000100:00100000:1.0:1788309579.075146:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210539136 00000100:00100000:1.0:1788309579.075194:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788309579.075203:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8eff0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5839:x1875178210539136:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788309579.075318:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8eff0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5839:x1875178210539136:12345-0@lo:1000:mdt00_002.0 Request processed in 71us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309579.075325:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788309579.075357:0:5839:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:1.0:1788309579.075522:0:5839:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97c8ecdaf480, transno 4294967315 00000004:00080000:1.0:1788309579.075534:0:5839:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:1.0:1788309579.075615:0:5839:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97c8ec685500, transno 4294967321 00000100:00100000:1.0:1788309579.075623:0:5839:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff97c8ec684700 x1875178210538368/t4294967322(4294967322) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788309594 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788309579.075635:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5839:1875178210539136:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1788309579.076188:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:1.0:1788309579.076256:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5839:1875178210539264:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788309579.076457:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309579.076483:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8eff1e240 going to sleep for 11 seconds 00000100:00100000:2.0:1788309579.077679:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210539264 00000100:00100000:2.0:1788309579.077698:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210539264 00000100:00100000:2.0:1788309579.077739:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788309579.077747:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f52a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5839:x1875178210539264:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788309579.077964:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f52a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5839:x1875178210539264:12345-0@lo:1000:mdt00_002.0 Request processed in 217us (1505us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1788309579.077972:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788309579.078952:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5839:1875178210539264:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1788309579.079009:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc935400/0x63a04852f462959d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309579.079030:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc935400/0x63a04852f462959d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309579.079038:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc935400/0x63a04852f462959d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309579.079046:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8fc935400 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:0.0:1788309579.079051:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc935400/0x63a04852f462959d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309579.079060:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc935400/0x63a04852f462959d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309579.079077:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97c8e2544100) 00010000:00010000:0.0:1788309579.079080:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788309579.079086:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc935400/0x63a04852f462959d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309579.079093:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc935400/0x63a04852f462959d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309579.079125:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548400/0x63a04852f46294e0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309579.079131:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548400/0x63a04852f46294e0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309579.079136:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548400/0x63a04852f46294e0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309579.079140:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8f5548400 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:0.0:1788309579.079149:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548400/0x63a04852f46294e0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309579.079156:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548400/0x63a04852f46294e0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309579.079175:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97c8d83f4b00) 00010000:00010000:0.0:1788309579.079178:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788309579.079186:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f46294e7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad26 expref: 23 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309579.079198:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f46294e7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad26 expref: 23 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309579.079207:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f46294e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad26 expref: 23 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309579.079248:0:5839:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f46294e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad26 expref: 23 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309579.079264:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8c958d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875178210539392:192.168.202.55@tcp:105: 00000100:00100000:0.0:1788309579.079435:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d69323c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788309579.084925:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309579.084982:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192730880 00000100:00100000:3.0:1788309579.084996:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192730880 00000100:00100000:3.0:1788309579.085047:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 61 00000100:00100000:3.0:1788309579.085058:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f524dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+24:11602:x1875178192730880:12345-192.168.202.55@tcp:49:lfs.0 00000100:00100000:3.0:1788309579.085204:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f524dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+24:11602:x1875178192730880:12345-192.168.202.55@tcp:49:lfs.0 Request processed in 148us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309579.085212:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 61 00000100:00100000:2.0:1788309579.088403:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309579.088577:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192731136 00000100:00100000:3.0:1788309579.088588:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192731136 00000100:00100000:3.0:1788309579.088641:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 231 00000100:00100000:3.0:1788309579.088651:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f5241500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+24:11602:x1875178192731136:12345-192.168.202.55@tcp:58:lfs.0 00000040:00080000:3.0:1788309579.089060:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1788309579.089144:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f5241500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+24:11602:x1875178192731136:12345-192.168.202.55@tcp:58:lfs.0 Request processed in 493us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309579.089152:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 231 00000100:00100000:1.0:1788309579.092793:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8c958d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875178210539392:192.168.202.55@tcp:105: 00010000:00010000:1.0:1788309579.092836:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548400/0x63a04852f46294e0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309579.092846:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548400/0x63a04852f46294e0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309579.092967:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934200/0x63a04852f46295a4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309579.092988:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934200/0x63a04852f46295a4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309579.092997:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934200/0x63a04852f46295a4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309579.093007:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934200/0x63a04852f46295a4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309579.093011:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934200/0x63a04852f46295a4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309579.093016:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934200/0x63a04852f46295a4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309579.093019:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8fc934200 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309579.093023:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934200/0x63a04852f46295a4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309579.093030:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934200/0x63a04852f46295a4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309579.093059:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97c8d83f4b00) 00010000:00010000:2.0:1788309579.093062:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788309579.093066:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934200/0x63a04852f46295a4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309579.093073:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934200/0x63a04852f46295a4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309579.093083:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934e00/0x63a04852f4629596 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309579.093087:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934e00/0x63a04852f4629596 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309579.093091:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934e00/0x63a04852f4629596 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309579.093094:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8fc934e00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309579.093095:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934e00/0x63a04852f4629596 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309579.093098:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934e00/0x63a04852f4629596 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309579.093103:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97c8d83f4b00) 00010000:00010000:2.0:1788309579.093104:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788309579.093106:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934e00/0x63a04852f4629596 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309579.093109:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934e00/0x63a04852f4629596 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309579.093330:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecf15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+23:11603:x1875178192730624:12345-192.168.202.55@tcp:57:lhsmtool_posix.0 Request processed in 29306us (29590us total) trans 4294967512 rc 0/0 00000100:00100000:2.0:1788309579.093338:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 230 00000020:00080000:2.0:1788309579.093343:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788309579.093766:0:11678:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788309579.093770:0:11678:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788309579.093802:0:11678:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788309579.093808:0:11678:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788309579.093919:0:11678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8f52aa300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11678:1875178210539520:192.168.202.55@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788309579.093974:0:11678:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8e6bc1600 going to sleep for 11 seconds 00000100:00100000:1.0:1788309579.106449:0:11678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8f52aa300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11678:1875178210539520:192.168.202.55@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788309579.107702:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309579.107782:0:8305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192731264 00000100:00100000:0.0:1788309579.107794:0:8305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192731264 00000100:00100000:0.0:1788309579.107864:0:8305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 232 00000100:00100000:0.0:1788309579.107876:0:8305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f5240700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+23:11604:x1875178192731264:12345-192.168.202.55@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788309579.107911:0:8305:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788309579.108123:0:8305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f5240700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+23:11604:x1875178192731264:12345-192.168.202.55@tcp:53:lhsmtool_posix.0 Request processed in 247us (2135us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309579.108132:0:8305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 232 00000100:00100000:0.0:1788309579.128184:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309579.128395:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192731520 00000100:00100000:3.0:1788309579.128406:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192731520 00000100:00100000:3.0:1788309579.128468:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 62 00000100:00100000:3.0:1788309579.128479:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6639050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+23:11603:x1875178192731520:12345-192.168.202.55@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788309579.129184:0:5841:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788309579.129360:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:3.0:1788309579.129411:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f46295ab lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309579.129429:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f46295ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309579.129441:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f46295ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309579.129450:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f46295ab lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309579.129456:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f46295ab lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309579.129462:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f46295ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309579.129482:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788309579.129582:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6639050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+25:11603:x1875178192731520:12345-192.168.202.55@tcp:35:lhsmtool_posix.0 Request processed in 1102us (1416us total) trans 4294967514 rc 0/0 00000100:00100000:3.0:1788309579.129590:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 62 00000020:00080000:3.0:1788309579.129596:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788309579.129802:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788309579.129810:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f46295ab lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309579.129818:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8c153ac00 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:1.0:1788309579.129823:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f46295ab lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309579.129830:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f46295ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309579.129844:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97c8e2544a00) 00010000:00010000:1.0:1788309579.129854:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788309579.129859:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f46295ab lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309579.129864:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f46295ab lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309579.129882:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309579.129884:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309579.129886:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788309579.130860:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309579.137224:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192731776 00000100:00100000:2.0:1788309579.137241:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192731776 00000100:00100000:2.0:1788309579.137338:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 233 00000100:00100000:2.0:1788309579.137351:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f524ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+25:11604:x1875178192731776:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788309579.137812:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309579.137838:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934200/0x63a04852f46295b2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ad5e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309579.137951:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934800/0x63a04852f46295b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309579.137966:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934800/0x63a04852f46295b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309579.137977:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934800/0x63a04852f46295b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788309579.138672:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788309579.138814:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934200/0x63a04852f46295b2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad5e expref: 28 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309579.138835:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934800/0x63a04852f46295b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad5e expref: 27 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309579.138863:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97c8d83f4b00) 00010000:00010000:2.0:1788309579.138866:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788309579.138869:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8fc934800, rc 0) 00000100:00100000:2.0:1788309579.138938:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f524ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+27:11604:x1875178192731776:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 1590us (8082us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1788309579.138946:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 233 00000100:00100000:2.0:1788309579.152049:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309579.152136:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309579.152309:0:8305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192731904 00000100:00100000:0.0:1788309579.152320:0:8305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192731904 00000100:00100000:0.0:1788309579.152379:0:8305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192732160 00000100:00100000:0.0:1788309579.152383:0:8305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192732160 00000100:00100000:0.0:1788309579.152411:0:8305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 234 00000100:00100000:0.0:1788309579.152421:0:8305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffcd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+28:11606:x1875178192731904:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:0.0:1788309579.152448:0:8305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788309579.152487:0:8305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e400/0x63a04852f46295c7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ad65 expref: -99 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309579.152718:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 235 00000100:00100000:2.0:1788309579.152729:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffcda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+29:11604:x1875178192732160:12345-192.168.202.55@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788309579.152792:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934200/0x63a04852f46295ce lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309579.152810:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934200/0x63a04852f46295ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309579.152822:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934200/0x63a04852f46295ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309579.153028:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934200/0x63a04852f46295ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309579.153036:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934200/0x63a04852f46295ce lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309579.153043:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934200/0x63a04852f46295ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309579.153067:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8fc934200 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309579.153073:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934200/0x63a04852f46295ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309579.153080:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934200/0x63a04852f46295ce lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309579.153092:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97c8d83f4b00) 00010000:00010000:2.0:1788309579.153095:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788309579.153101:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934200/0x63a04852f46295ce lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309579.153107:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934200/0x63a04852f46295ce lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309579.153378:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffcda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+30:11604:x1875178192732160:12345-192.168.202.55@tcp:57:lhsmtool_posix.0 Request processed in 650us (1240us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1788309579.153388:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 235 00000040:00080000:2.0:1788309579.153508:0:11678:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00010000:00010000:0.0:1788309579.154174:0:8305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2fe00/0x63a04852f46295d5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309579.154191:0:8305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2fe00/0x63a04852f46295d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309579.154202:0:8305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2fe00/0x63a04852f46295d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788309579.154676:0:11678:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00010000:00010000:0.0:1788309579.154930:0:8305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2fc00/0x63a04852f46295dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309579.154944:0:8305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2fc00/0x63a04852f46295dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309579.154952:0:8305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2fc00/0x63a04852f46295dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788309579.156206:0:11678:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788309579.156219:0:11678:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788309579.156444:0:8305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f200/0x63a04852f46295e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309579.156464:0:8305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934600/0x63a04852f46294d2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad1f expref: 29 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309579.156487:0:8305:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f200/0x63a04852f46295e3 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309579.156537:0:8305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934600/0x63a04852f46294d2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad1f expref: 29 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309579.156785:0:8305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934600/0x63a04852f46294d2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad1f expref: 29 pid: 5839 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309579.156804:0:8305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8f524dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8305:1875178210539648:192.168.202.55@tcp:104: 00000100:00100000:0.0:1788309579.156890:0:8305:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d69320c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788309579.160919:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309579.161076:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309579.161139:0:8305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8f524dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8305:1875178210539648:192.168.202.55@tcp:104: 00010000:00010000:0.0:1788309579.161178:0:8305:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f200/0x63a04852f46295e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309579.161665:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192732416 00000100:00100000:3.0:1788309579.161673:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192732416 00000100:00100000:3.0:1788309579.161713:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192732672 00000100:00100000:3.0:1788309579.161715:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192732672 00000100:00100000:3.0:1788309579.161729:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 63 00000100:00100000:3.0:1788309579.161739:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f52aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+31:11604:x1875178192732416:12345-192.168.202.55@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788309579.162013:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f52aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+32:11604:x1875178192732416:12345-192.168.202.55@tcp:35:lhsmtool_posix.0 Request processed in 274us (1102us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1788309579.162021:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 63 00000100:00100000:3.0:1788309579.162040:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 64 00000100:00100000:3.0:1788309579.162046:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f52ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+31:5589:x1875178192732672:12345-192.168.202.55@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788309579.162114:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f52ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+32:5589:x1875178192732672:12345-192.168.202.55@tcp:35:ldlm_bl.0 Request processed in 67us (1038us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1788309579.162120:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 64 00000100:00100000:2.0:1788309579.165952:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309579.166685:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192732800 00000100:00100000:0.0:1788309579.166697:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192732800 00010000:00010000:0.0:1788309579.166740:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934600/0x63a04852f46294d2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad1f expref: 32 pid: 5839 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309579.166788:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 85 00000100:00100000:0.0:1788309579.166816:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffcd8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+32:2350:x1875178192732800:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788309579.166831:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788309579.166840:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934600/0x63a04852f46294d2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad1f expref: 32 pid: 5839 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309579.166853:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934600/0x63a04852f46294d2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad1f expref: 32 pid: 5839 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309579.166875:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934600/0x63a04852f46294d2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad1f expref: 32 pid: 5839 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309579.166890:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97c8d83f4b00) 00010000:00010000:0.0:1788309579.166908:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f200/0x63a04852f46295e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309579.166918:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f200/0x63a04852f46295e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309579.166927:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f200/0x63a04852f46295e3 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309579.166964:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788309579.167028:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffcd8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+31:2350:x1875178192732800:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 215us (1085us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309579.167036:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 85 00010000:00010000:1.0:1788309579.167144:0:8305:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f200/0x63a04852f46295e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309579.167153:0:8305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f200/0x63a04852f46295e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788309579.167205:0:8305:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788309579.167209:0:8305:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788309579.167230:0:8305:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f200/0x63a04852f46295e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309579.167244:0:8305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f200/0x63a04852f46295e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309579.167254:0:8305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2fe00/0x63a04852f46295d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309579.167260:0:8305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2fe00/0x63a04852f46295d5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309579.167267:0:8305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2fe00/0x63a04852f46295d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309579.167334:0:8305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8ecf2fe00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:1.0:1788309579.167340:0:8305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2fe00/0x63a04852f46295d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309579.167347:0:8305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2fe00/0x63a04852f46295d5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309579.167357:0:8305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97c8d832f200) 00010000:00010000:1.0:1788309579.167359:0:8305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788309579.167363:0:8305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2fe00/0x63a04852f46295d5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309579.167369:0:8305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2fe00/0x63a04852f46295d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309579.167382:0:8305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2fc00/0x63a04852f46295dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309579.167388:0:8305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2fc00/0x63a04852f46295dc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309579.167394:0:8305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2fc00/0x63a04852f46295dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309579.167399:0:8305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8ecf2fc00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:1.0:1788309579.167402:0:8305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2fc00/0x63a04852f46295dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309579.167407:0:8305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2fc00/0x63a04852f46295dc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309579.167425:0:8305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97c8c2ab9700) 00010000:00010000:1.0:1788309579.167427:0:8305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788309579.167430:0:8305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2fc00/0x63a04852f46295dc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309579.167437:0:8305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2fc00/0x63a04852f46295dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309579.167472:0:8305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e400/0x63a04852f46295c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad65 expref: 31 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309579.167485:0:8305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f200/0x63a04852f46295e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad65 expref: 30 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309579.167491:0:8305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97c8d83f4b00) 00010000:00010000:1.0:1788309579.167493:0:8305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788309579.167496:0:8305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8ecf2f200, rc 0) 00000100:00100000:1.0:1788309579.167539:0:8305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffcd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+30:11606:x1875178192731904:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 15119us (15501us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309579.167968:0:8305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 234 00000100:00100000:2.0:1788309579.234483:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffeb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875178210540032:0@lo:400:kworker.0 00000100:00100000:2.0:1788309579.234566:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309579.234619:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788309579.234625:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffcd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875178210539904:0@lo:400:kworker.0 00000100:00100000:2.0:1788309579.234648:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309579.234691:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210540032 00000100:00100000:2.0:1788309579.234698:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210540032 00000100:00100000:2.0:1788309579.234748:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210539904 00000100:00100000:2.0:1788309579.234751:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210539904 00000100:00100000:2.0:1788309579.234771:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788309579.234780:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffeb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875178210540032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309579.234843:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffeb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875178210540032:12345-0@lo:400:kworker.0 Request processed in 64us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309579.234850:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788309579.234866:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788309579.234872:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffeb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875178210539904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309579.234897:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffeb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875178210539904:12345-0@lo:400:kworker.0 Request processed in 25us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309579.234903:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00080000:2.0:1788309579.234918:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788309579.234948:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffcd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875178210539904:0@lo:400:kworker.0 00000100:00100000:2.0:1788309579.234960:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffeb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875178210540032:0@lo:400:kworker.0 00000100:00100000:1.0:1788309579.235220:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffeb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875178210540160:0@lo:400:kworker.0 00000100:00100000:1.0:1788309579.235256:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309579.235325:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788309579.235332:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffcda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3302:1875178210539776:0@lo:400:kworker.0 00000100:00100000:1.0:1788309579.235361:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309579.235549:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210540160 00000100:00100000:2.0:1788309579.235554:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210540160 00000100:00100000:2.0:1788309579.235592:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788309579.235599:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f52a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875178210540160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309579.235634:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f52a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875178210540160:12345-0@lo:400:kworker.0 Request processed in 36us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309579.235640:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00080000:1.0:1788309579.235737:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788309579.235759:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffeb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875178210540160:0@lo:400:kworker.0 00000100:00100000:3.0:1788309579.236990:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210539776 00000100:00100000:3.0:1788309579.237008:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210539776 00000100:00100000:3.0:1788309579.237095:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1788309579.237107:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6a6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:3302:x1875178210539776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309579.237224:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6a6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:3302:x1875178210539776:12345-0@lo:400:kworker.0 Request processed in 119us (1861us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309579.237248:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1788309579.237698:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffcda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3302:1875178210539776:0@lo:400:kworker.0 00010000:00010000:3.0:1788309579.488533:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788309579.717979:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309579.718026:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309579.718063:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309579.718091:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309579.718137:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309579.718179:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192733440 00000100:00100000:0.0:1788309579.718191:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192733440 00000100:00100000:0.0:1788309579.718266:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192733056 00000100:00100000:0.0:1788309579.718269:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192733056 00000100:00100000:0.0:1788309579.718319:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 154 00000100:00100000:0.0:1788309579.718330:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc91dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ea7f0717-c12d-4408-bdfd-5a035f695b73+5:2351:x1875178192733440:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788309579.718417:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc91dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ea7f0717-c12d-4408-bdfd-5a035f695b73+5:2351:x1875178192733440:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 90us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309579.718425:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 154 00000100:00100000:0.0:1788309579.718442:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 155 00000100:00100000:0.0:1788309579.718450:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecdc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+30:2351:x1875178192733056:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788309579.718482:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecdc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+30:2351:x1875178192733056:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 33us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309579.718487:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 155 00000100:00100000:0.0:1788309579.718582:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192733184 00000100:00100000:0.0:1788309579.718586:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192733184 00000100:00100000:0.0:1788309579.718617:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192733312 00000100:00100000:0.0:1788309579.718620:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192733312 00000100:00100000:0.0:1788309579.718640:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 90 00000100:00100000:0.0:1788309579.718646:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f524dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+7:2351:x1875178192733184:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788309579.718675:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f524dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+7:2351:x1875178192733184:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 29us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309579.718681:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 90 00000100:00100000:0.0:1788309579.718691:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 91 00000100:00100000:0.0:1788309579.718696:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecdc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+7:2351:x1875178192733312:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788309579.718729:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecdc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+7:2351:x1875178192733312:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 31us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309579.718736:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 91 00000100:00080000:0.0:1788309579.718753:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788309579.718757:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788309579.719018:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192732928 00000100:00100000:2.0:1788309579.719023:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192732928 00000100:00100000:2.0:1788309579.719055:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 298 00000100:00100000:2.0:1788309579.719070:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6a6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8351692-8d1a-4b41-bdaf-bf179786ff59+13:2351:x1875178192732928:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:2.0:1788309579.719100:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6a6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8351692-8d1a-4b41-bdaf-bf179786ff59+13:2351:x1875178192732928:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 32us (1133us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309579.719107:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 298 00000100:00100000:0.0:1788309579.751325:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffeb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210540288:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788309579.751402:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309579.751634:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210540288 00000100:00100000:2.0:1788309579.751642:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210540288 00000100:00100000:2.0:1788309579.751699:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788309579.751710:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecdaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1875178210540288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788309579.751734:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1788309579.751787:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecdaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1875178210540288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309579.751795:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788309579.751856:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffeb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210540288:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1788309579.871320:0:6706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:2.0:1788309579.871338:0:6706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:2.0:1788309579.871349:0:6706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000040:00080000:0.0:1788309580.143556:0:12558:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788309580.143566:0:12558:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788309580.143616:0:12558:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788309580.143622:0:12558:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788309580.256487:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788309580.256519:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecdadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210540416:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788309580.256593:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309580.256661:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210540416 00000100:00100000:0.0:1788309580.256669:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210540416 00000100:00100000:0.0:1788309580.256727:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788309580.256739:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffcab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875178210540416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788309580.256792:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788309580.256839:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffcab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875178210540416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309580.256849:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:0.0:1788309580.256870:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788309580.256897:0:3301:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1788309580.256902:0:3301:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97c8edf30700, transno 4294967307 00000004:00080000:0.0:1788309580.256914:0:3301:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:0.0:1788309580.256935:0:3301:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97c8e6584000, transno 4294967310 00000100:00100000:0.0:1788309580.256965:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecdadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210540416:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788309580.349849:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309580.349936:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192733696 00000100:00100000:2.0:1788309580.349949:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192733696 00000100:00100000:2.0:1788309580.350019:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 236 00000100:00100000:2.0:1788309580.350030:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffcaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+30:11629:x1875178192733696:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:2.0:1788309580.350055:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309580.350086:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934000/0x63a04852f46295ea lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ad6c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309580.350236:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc935600/0x63a04852f46295f1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309580.350267:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc935600/0x63a04852f46295f1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309580.350314:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc935600/0x63a04852f46295f1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788309580.350329:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788309580.350460:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934000/0x63a04852f46295ea lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad6c expref: 33 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309580.350479:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc935600/0x63a04852f46295f1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad6c expref: 32 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309580.350488:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97c8d83f4b00) 00010000:00010000:2.0:1788309580.350491:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788309580.350495:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8fc935600, rc 0) 00000100:00100000:2.0:1788309580.350802:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffcaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+32:11629:x1875178192733696:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 772us (962us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1788309580.350810:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 236 00000100:00100000:0.0:1788309580.354056:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309580.354131:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192733824 00000100:00100000:3.0:1788309580.354142:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192733824 00000100:00100000:3.0:1788309580.354230:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 237 00000100:00100000:3.0:1788309580.354241:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecdadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+32:11629:x1875178192733824:12345-192.168.202.55@tcp:54:lfs.0 00010000:00010000:3.0:1788309580.354351:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f46295ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309580.354370:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f46295ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309580.354382:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f46295ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309580.354410:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f46295ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309580.354416:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f46295ff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309580.354422:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f46295ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309580.354428:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8c153ac00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:3.0:1788309580.354433:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f46295ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309580.354441:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f46295ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309580.354469:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97c8d83f4b00) 00010000:00010000:3.0:1788309580.354472:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788309580.354477:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f46295ff lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309580.354483:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153ac00/0x63a04852f46295ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309580.354739:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecdadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+32:11629:x1875178192733824:12345-192.168.202.55@tcp:54:lfs.0 Request processed in 499us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309580.354747:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 237 00000100:00100000:3.0:1788309580.477588:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309580.477883:0:12478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192733952 00000100:00100000:2.0:1788309580.477894:0:12478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192733952 00000100:00100000:2.0:1788309580.477966:0:12478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 71 00000100:00100000:2.0:1788309580.477977:0:12478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6979c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+7:2353:x1875178192733952:12345-192.168.202.55@tcp:101:cat.0 00010000:00010000:2.0:1788309580.477996:0:12478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309580.478019:0:12478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e54aaad2/0x63a04852f4629606 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ad73 expref: -99 pid: 12478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788309580.478072:0:12478:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a977049, atime: 0x6a977049, ctime: 0x6a977049, blocks: 0xb 00010000:00010000:2.0:1788309580.478099:0:12478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=343s v=(0 0) 00010000:00010000:2.0:1788309580.478104:0:12478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788309580.478114:0:12478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e54aaad2/0x63a04852f4629606 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad73 expref: 8 pid: 12478 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309580.478135:0:12478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e54aaad2/0x63a04852f4629606 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad73 expref: 8 pid: 12478 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309580.478162:0:12478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8fc934000, rc 0) 00000100:00100000:2.0:1788309580.478222:0:12478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6979c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+8:2353:x1875178192733952:12345-192.168.202.55@tcp:101:cat.0 Request processed in 246us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309580.478230:0:12478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 71 00000100:00080000:0.0:1788309580.478318:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788309580.484856:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309580.484970:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192734080 00000100:00100000:2.0:1788309580.484979:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192734080 00002000:00100000:2.0:1788309580.485024:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff97c8efef9f80 x1875178192734080/t0(0) o3->86451057-f8bb-4d7c-a7c2-5c834b43e3d3@192.168.202.55@tcp:736/0 lens 488/0 e 0 to 0 dl 1788309591 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788309580.485032:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97c8efef9f80 with x1875178192734080 ext(0->4095) 00002000:00010000:2.0:1788309580.485036:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97c8efef9f80 00000100:00100000:2.0:1788309580.485095:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 7 00000100:00100000:2.0:1788309580.485116:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8efef9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+8:2352:x1875178192734080:12345-192.168.202.55@tcp:3:cat.0 00000100:00100000:2.0:1788309580.485394:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8efef9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+8:2352:x1875178192734080:12345-192.168.202.55@tcp:3:cat.0 Request processed in 289us (550us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788309580.485412:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 7 00002000:00100000:2.0:1788309580.485419:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff97c8efef9f80 x1875178192734080/t0(0) o3->86451057-f8bb-4d7c-a7c2-5c834b43e3d3@192.168.202.55@tcp:736/0 lens 488/4536 e 0 to 0 dl 1788309591 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788309580.485427:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97c8efef9f80 with x1875178192734080 ext(0->4095) 00002000:00010000:2.0:1788309580.485430:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97c8efef9f80 00010000:00010000:0.0:1788309580.518843:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309581.536629:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309582.562763:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788309583.266468:0:11678:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788309583.266497:0:11678:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788309583.266535:0:11678:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788309583.266541:0:11678:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788309583.584840:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788309584.352786:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8f5244380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3301:1875178210540544:0@lo:400:kworker.0 00000100:00100000:0.0:1788309584.352861:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8f5246300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875178210540672:0@lo:400:kworker.0 00000100:00100000:1.0:1788309584.352893:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309584.352946:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309584.352983:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ec976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875178210541056:0@lo:400:kworker.0 00000100:00100000:0.0:1788309584.352991:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8d6814e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875178210541184:0@lo:400:kworker.0 00000100:00100000:1.0:1788309584.353041:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309584.353049:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309584.353162:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ec975f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210540928:0@lo:400:kworker.0 00000100:00100000:1.0:1788309584.354961:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210540544 00000100:00100000:1.0:1788309584.354977:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210540544 00000100:00100000:1.0:1788309584.355042:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1788309584.355052:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6a6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:3301:x1875178210540544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309584.355148:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6a6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:3301:x1875178210540544:12345-0@lo:400:kworker.0 Request processed in 97us (2258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309584.355157:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1788309584.357930:0:8305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210540672 00000100:00100000:1.0:1788309584.357947:0:8305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210540672 00000100:00100000:1.0:1788309584.358012:0:8305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210541056 00000100:00100000:1.0:1788309584.358016:0:8305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210541056 00000100:00100000:1.0:1788309584.358058:0:8305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788309584.358071:0:8305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6817480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875178210540672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309584.358173:0:8305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6817480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875178210540672:12345-0@lo:400:kworker.0 Request processed in 106us (5229us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309584.358181:0:8305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788309584.358210:0:8305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788309584.358216:0:8305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f52aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875178210541056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309584.358461:0:8305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f52aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875178210541056:12345-0@lo:400:kworker.0 Request processed in 33us (5209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309584.358469:0:8305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00080000:1.0:1788309584.358496:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788309584.365209:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210541184 00000100:00100000:0.0:1788309584.365595:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210541184 00000100:00100000:0.0:1788309584.365695:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788309584.365783:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6815f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3302:x1875178210541184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309584.365972:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6815f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3302:x1875178210541184:12345-0@lo:400:kworker.0 Request processed in 266us (12928us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309584.365981:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788309584.366064:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8d6814e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875178210541184:0@lo:400:kworker.0 00000100:00100000:0.0:1788309584.366111:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8f5246300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875178210540672:0@lo:400:kworker.0 00000100:00100000:0.0:1788309584.366137:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788309584.366150:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ec974700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875178210540800:0@lo:400:kworker.0 00000100:00100000:0.0:1788309584.366198:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309584.366910:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ec976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875178210541056:0@lo:400:kworker.0 00000100:00100000:1.0:1788309584.366949:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8f5244380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3301:1875178210540544:0@lo:400:kworker.0 00000100:00080000:1.0:1788309584.367009:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788309584.367035:0:8305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210540800 00000100:00100000:1.0:1788309584.367044:0:8305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210540800 00000100:00100000:1.0:1788309584.367112:0:8305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788309584.367131:0:8305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6814e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875178210540800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309584.367223:0:8305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6814e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875178210540800:12345-0@lo:400:kworker.0 Request processed in 94us (1025us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309584.367231:0:8305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:1.0:1788309584.368227:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788309584.369401:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309584.369486:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210540928 00000100:00100000:2.0:1788309584.369495:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210540928 00000100:00100000:2.0:1788309584.369569:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788309584.369580:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffeb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1875178210540928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309584.369659:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffeb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1875178210540928:12345-0@lo:400:kworker.0 Request processed in 81us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309584.369667:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:2.0:1788309584.369722:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788309584.369867:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ec975f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210540928:0@lo:400:kworker.0 00000100:00100000:0.0:1788309584.372042:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ec974700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875178210540800:0@lo:400:kworker.0 00000001:00080000:3.0:1788309584.440308:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967507 is committed 00000001:00080000:3.0:1788309584.440338:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967512 is committed 00000020:00080000:3.0:1788309584.440349:0:5859:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff97c8eff1e780 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1788309584.440356:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97c8ffbb4b00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff97c8eff1e480 00000020:00080000:3.0:1788309584.440360:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97c8ffbb4400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff97c8d697f800 00000020:00080000:3.0:1788309584.440388:0:5859:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000001:00080000:3.0:1788309584.440397:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:0.0:1788309584.440675:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1788309584.440953:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:3.0:1788309584.454741:0:7639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:3.0:1788309584.455224:0:7639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:3.0:1788309584.455569:0:7639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00010000:00010000:0.0:1788309584.611725:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788309584.840217:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309584.840272:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309584.840340:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309584.840345:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192734208 00000100:00100000:3.0:1788309584.840357:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192734208 00000100:00100000:0.0:1788309584.840367:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309584.840399:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309584.840427:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192734720 00000100:00100000:3.0:1788309584.840429:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 300 00000100:00100000:0.0:1788309584.840432:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192734720 00000100:00100000:3.0:1788309584.840444:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6a6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8351692-8d1a-4b41-bdaf-bf179786ff59+13:2350:x1875178192734208:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788309584.840481:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192734336 00000100:00100000:0.0:1788309584.840486:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192734336 00000100:00100000:0.0:1788309584.840524:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 159 00000100:00100000:3.0:1788309584.840534:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6a6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8351692-8d1a-4b41-bdaf-bf179786ff59+13:2350:x1875178192734208:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 92us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309584.840536:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f5244380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ea7f0717-c12d-4408-bdfd-5a035f695b73+5:2350:x1875178192734720:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788309584.840550:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 300 00000100:00100000:0.0:1788309584.840581:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f5244380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ea7f0717-c12d-4408-bdfd-5a035f695b73+5:2350:x1875178192734720:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 48us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309584.840587:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 159 00000100:00100000:0.0:1788309584.840601:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 160 00000100:00100000:0.0:1788309584.840608:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f5246300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+19:2350:x1875178192734336:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788309584.840638:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f5246300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+19:2350:x1875178192734336:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 31us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309584.840645:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 160 00000100:00100000:0.0:1788309584.840668:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192734464 00000100:00100000:0.0:1788309584.840671:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192734464 00000100:00100000:0.0:1788309584.840707:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192734592 00000100:00100000:0.0:1788309584.840711:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192734592 00000100:00100000:0.0:1788309584.840736:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 94 00000100:00100000:0.0:1788309584.840743:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6817100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+5:2350:x1875178192734464:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788309584.840779:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6817100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+5:2350:x1875178192734464:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 36us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309584.840785:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 94 00000100:00100000:0.0:1788309584.840796:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 95 00000100:00100000:0.0:1788309584.840802:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffbb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+7:2350:x1875178192734592:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788309584.840824:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffbb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+7:2350:x1875178192734592:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 22us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309584.840829:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 95 00000100:00080000:0.0:1788309584.840843:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788309584.840846:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788309584.840848:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788309584.870803:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e697b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210541312:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788309584.870882:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309584.870947:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210541312 00000100:00100000:3.0:1788309584.870954:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210541312 00000100:00100000:3.0:1788309584.870996:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788309584.871004:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e697a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210541312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788309584.871037:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788309584.871081:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e697a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210541312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309584.871089:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788309584.871136:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:3.0:1788309584.871142:0:3303:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97c8ec684700, transno 4294967322 00000004:00080000:3.0:1788309584.871151:0:3303:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:3.0:1788309584.871175:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e697b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210541312:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788309585.378073:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788309585.378096:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8f52ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210541440:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788309585.378174:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309585.379081:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210541440 00000100:00100000:3.0:1788309585.379094:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210541440 00000100:00100000:3.0:1788309585.379157:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788309585.379169:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f52a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875178210541440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788309585.379227:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788309585.379313:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f52a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875178210541440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 146us (1137us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309585.379322:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788309585.379392:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8f52ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210541440:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788309585.601572:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309585.601702:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192734848 00000100:00100000:0.0:1788309585.601712:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192734848 00000100:00100000:0.0:1788309585.601770:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 238 00000100:00100000:0.0:1788309585.601778:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e697b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+19:11290:x1875178192734848:12345-192.168.202.55@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788309585.602034:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e697b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+19:11290:x1875178192734848:12345-192.168.202.55@tcp:60:lhsmtool_posix.0 Request processed in 254us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309585.602043:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 238 00000100:00100000:0.0:1788309585.607716:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309585.607920:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192735104 00000100:00100000:2.0:1788309585.607931:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192735104 00000100:00100000:2.0:1788309585.607988:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 65 00000100:00100000:2.0:1788309585.607998:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffbb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+19:11290:x1875178192735104:12345-192.168.202.55@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788309585.608925:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffbb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+20:11290:x1875178192735104:12345-192.168.202.55@tcp:35:lhsmtool_posix.0 Request processed in 924us (1215us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1788309585.608937:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 65 00010000:00010000:0.0:1788309585.633044:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788309585.974767:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309585.974877:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192735232 00000100:00100000:0.0:1788309585.974887:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192735232 00000100:00100000:0.0:1788309585.974951:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 239 00000100:00100000:0.0:1788309585.974961:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffeb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ea7f0717-c12d-4408-bdfd-5a035f695b73+5:12081:x1875178192735232:12345-192.168.202.55@tcp:101:lsof.0 00010000:00010000:0.0:1788309585.974981:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788309585.975009:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f800/0x63a04852f462960d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ad7a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309585.975068:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f000/0x63a04852f4629614 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309585.975081:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f000/0x63a04852f4629614 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309585.975092:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f000/0x63a04852f4629614 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788309585.975344:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1788309585.975348:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1788309585.975417:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f000/0x63a04852f4629614 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309585.975444:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f800/0x63a04852f462960d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad7a expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309585.975463:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f000/0x63a04852f4629614 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad7a expref: 6 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309585.975472:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c8d83f4800) 00010000:00010000:0.0:1788309585.975476:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788309585.975480:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8ecf2f000, rc 0) 00000100:00100000:0.0:1788309585.975544:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffeb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ea7f0717-c12d-4408-bdfd-5a035f695b73+6:12081:x1875178192735232:12345-192.168.202.55@tcp:101:lsof.0 Request processed in 584us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309585.975551:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 239 00010000:00010000:1.0:1788309586.657658:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309587.680664:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309588.704481:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788309589.071841:0:12758:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 20:39:47 (1788309587) 00000100:00100000:1.0:1788309589.474493:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8f52ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3301:1875178210541568:0@lo:400:kworker.0 00000100:00100000:1.0:1788309589.474723:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309589.474793:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8c958d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875178210542080:0@lo:400:kworker.0 00000100:00100000:1.0:1788309589.474826:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309589.475024:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788309589.475041:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ec976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210541952:0@lo:400:kworker.0 00000100:00100000:1.0:1788309589.475103:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309589.475139:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ec974700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875178210541696:0@lo:400:kworker.0 00000100:00100000:1.0:1788309589.475170:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309589.475264:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ec684700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875178210542208:0@lo:400:kworker.0 00000100:00100000:1.0:1788309589.475314:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309589.475335:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788309589.475341:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ec975f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875178210541824:0@lo:400:kworker.0 00000100:00100000:1.0:1788309589.475363:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309589.475402:0:8305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210542080 00000100:00100000:1.0:1788309589.475411:0:8305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210542080 00000100:00100000:0.0:1788309589.475551:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210541952 00000100:00100000:0.0:1788309589.475558:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210541952 00000100:00100000:1.0:1788309589.475665:0:8305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210541696 00000100:00100000:1.0:1788309589.475669:0:8305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210541696 00000100:00100000:1.0:1788309589.475686:0:8305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210541824 00000100:00100000:1.0:1788309589.475689:0:8305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210541824 00000100:00100000:2.0:1788309589.475736:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210541568 00000100:00100000:2.0:1788309589.475742:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210541568 00000100:00100000:2.0:1788309589.475797:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1788309589.475810:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6a6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:3301:x1875178210541568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309589.475895:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6a6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:3301:x1875178210541568:12345-0@lo:400:kworker.0 Request processed in 87us (1173us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309589.475904:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1788309589.475965:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788309589.475975:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ec685500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875178210542080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309589.476009:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ec685500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875178210542080:12345-0@lo:400:kworker.0 Request processed in 37us (1183us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309589.476016:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788309589.476031:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788309589.476037:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecb40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875178210541696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309589.476084:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecb40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875178210541696:12345-0@lo:400:kworker.0 Request processed in 47us (914us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309589.476090:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788309589.476625:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210542208 00000100:00100000:0.0:1788309589.476633:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210542208 00000100:00100000:0.0:1788309589.476661:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788309589.476671:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecb43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875178210541952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309589.476726:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecb43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875178210541952:12345-0@lo:400:kworker.0 Request processed in 59us (1624us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309589.476733:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788309589.476748:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788309589.476754:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecb42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875178210542208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309589.476799:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecb42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875178210542208:12345-0@lo:400:kworker.0 Request processed in 45us (1484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309589.476804:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788309589.484616:0:8305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788309589.484641:0:8305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecb41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875178210541824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309589.484790:0:8305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecb41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875178210541824:12345-0@lo:400:kworker.0 Request processed in 158us (9424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309589.484798:0:8305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00080000:2.0:1788309589.485608:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788309589.485715:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ec976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210541952:0@lo:400:kworker.0 00000100:00100000:2.0:1788309589.485733:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8f52ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3301:1875178210541568:0@lo:400:kworker.0 00000100:00100000:2.0:1788309589.485747:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8c958d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875178210542080:0@lo:400:kworker.0 00000100:00100000:1.0:1788309589.485828:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ec975f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875178210541824:0@lo:400:kworker.0 00000100:00100000:1.0:1788309589.485865:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ec974700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875178210541696:0@lo:400:kworker.0 00000100:00080000:2.0:1788309589.485955:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788309589.485961:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788309589.486002:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ec684700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875178210542208:0@lo:400:kworker.0 00000020:00080000:1.0:1788309589.569224:0:5859:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000001:00080000:1.0:1788309589.569268:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:3.0:1788309589.569333:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1788309589.569346:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1788309589.728592:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788309589.969812:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309589.969852:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309589.969874:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309589.969898:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309589.969923:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309589.969949:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192735872 00000100:00100000:2.0:1788309589.969958:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192735872 00000100:00100000:2.0:1788309589.970017:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192735488 00000100:00100000:2.0:1788309589.970020:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192735488 00000100:00100000:2.0:1788309589.970042:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 164 00000100:00100000:2.0:1788309589.970052:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffeb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ea7f0717-c12d-4408-bdfd-5a035f695b73+6:2353:x1875178192735872:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:2.0:1788309589.970135:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffeb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ea7f0717-c12d-4408-bdfd-5a035f695b73+6:2353:x1875178192735872:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 85us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309589.970143:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 164 00000100:00100000:2.0:1788309589.970160:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 165 00000100:00100000:0.0:1788309589.970298:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192735616 00000100:00100000:0.0:1788309589.970303:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192735616 00000100:00100000:0.0:1788309589.970332:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192735744 00000100:00100000:0.0:1788309589.970335:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192735744 00000100:00100000:0.0:1788309589.970355:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 98 00000100:00100000:0.0:1788309589.970362:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffeb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+5:2353:x1875178192735616:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788309589.970390:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffeb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+5:2353:x1875178192735616:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 29us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309589.970397:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 98 00000100:00100000:0.0:1788309589.970409:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 99 00000100:00100000:0.0:1788309589.970415:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffeb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+7:2353:x1875178192735744:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788309589.970453:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffeb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+7:2353:x1875178192735744:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 37us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309589.970468:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 99 00000100:00100000:3.0:1788309589.970937:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192735360 00000100:00100000:3.0:1788309589.970942:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192735360 00000100:00100000:3.0:1788309589.970973:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 302 00000100:00100000:3.0:1788309589.970980:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6a6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8351692-8d1a-4b41-bdaf-bf179786ff59+13:2353:x1875178192735360:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788309589.971009:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6a6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8351692-8d1a-4b41-bdaf-bf179786ff59+13:2353:x1875178192735360:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 30us (1208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309589.971015:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 302 00000100:00100000:2.0:1788309589.971244:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffeb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+19:2353:x1875178192735488:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:2.0:1788309589.971307:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffeb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+19:2353:x1875178192735488:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 1140us (1407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309589.971315:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 165 00000100:00080000:2.0:1788309589.971342:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788309589.971347:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788309589.971349:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788309589.987468:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffeb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210542336:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788309589.987541:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309589.987613:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210542336 00000100:00100000:2.0:1788309589.987620:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210542336 00000100:00100000:2.0:1788309589.987668:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788309589.987694:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffeb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210542336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788309589.987728:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788309589.987772:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffeb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210542336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309589.987779:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788309589.987820:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffeb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210542336:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788309590.500259:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210542464:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788309590.500353:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309590.500431:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210542464 00000100:00100000:3.0:1788309590.500439:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210542464 00000100:00100000:3.0:1788309590.500482:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788309590.500490:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecf17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875178210542464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788309590.500523:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788309590.500561:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecf17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875178210542464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309590.500568:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788309590.500611:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210542464:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788309590.755764:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309591.776607:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309592.801192:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788309593.513296:0:11678:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788309593.513308:0:11678:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788309593.513773:0:11678:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1788309593.513782:0:11678:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788309593.834119:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788309594.100958:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309594.101114:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192736128 00000100:00100000:3.0:1788309594.101126:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192736128 00000100:00100000:3.0:1788309594.101235:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 66 00000100:00100000:3.0:1788309594.101247:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecb41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+19:12302:x1875178192736128:12345-192.168.202.55@tcp:35:umount.0 00000100:00100000:3.0:1788309594.101910:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecb41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+20:12302:x1875178192736128:12345-192.168.202.55@tcp:35:umount.0 Request processed in 663us (960us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1788309594.101919:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 66 00000100:00080000:2.0:1788309594.102392:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788309594.109898:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309594.111897:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192736384 00000100:00100000:3.0:1788309594.111915:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192736384 00000100:00100000:1.0:1788309594.112680:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 67 00000100:00100000:1.0:1788309594.112712:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffeb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+20:12302:x1875178192736384:12345-192.168.202.55@tcp:35:umount.0 00000100:00100000:1.0:1788309594.114365:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffeb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+21:12302:x1875178192736384:12345-192.168.202.55@tcp:35:umount.0 Request processed in 1663us (4468us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1788309594.114378:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 67 00000100:00100000:0.0:1788309594.121745:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309594.122642:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192736640 00000100:00100000:3.0:1788309594.122658:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192736640 00000100:00100000:3.0:1788309594.122744:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 68 00000100:00100000:3.0:1788309594.122760:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e663ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+21:12302:x1875178192736640:12345-192.168.202.55@tcp:35:umount.0 00000100:00100000:3.0:1788309594.125349:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e663ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+22:12302:x1875178192736640:12345-192.168.202.55@tcp:35:umount.0 Request processed in 2574us (3601us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1788309594.125367:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 68 00000100:00100000:1.0:1788309594.131214:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309594.131507:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192736896 00000100:00100000:2.0:1788309594.131516:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192736896 00000100:00100000:2.0:1788309594.131569:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 69 00000100:00100000:2.0:1788309594.131582:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecb40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+22:12302:x1875178192736896:12345-192.168.202.55@tcp:35:umount.0 00000100:00100000:2.0:1788309594.131933:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecb40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+23:12302:x1875178192736896:12345-192.168.202.55@tcp:35:umount.0 Request processed in 354us (728us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1788309594.131939:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 69 00000100:00100000:2.0:1788309594.142269:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309594.142344:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309594.142375:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309594.142414:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309594.142449:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192737536 00000100:00100000:2.0:1788309594.142461:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192737536 00000100:00100000:2.0:1788309594.142518:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192737408 00000100:00100000:2.0:1788309594.142521:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192737408 00000100:00100000:2.0:1788309594.142556:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192737664 00000100:00100000:2.0:1788309594.142558:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192737664 00000100:00100000:2.0:1788309594.142589:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 17 00000100:00100000:2.0:1788309594.142600:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffeb2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f8351692-8d1a-4b41-bdaf-bf179786ff59+15:2350:x1875178192737536:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788309594.142617:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788309594.142639:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c8d73ef400/0x63a04852f46285f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a8cd expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309594.142658:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788309594.142715:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffeb2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f8351692-8d1a-4b41-bdaf-bf179786ff59+14:2350:x1875178192737536:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 117us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309594.142723:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 17 00000100:00100000:2.0:1788309594.142741:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 18 00000100:00100000:2.0:1788309594.142748:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6b29450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f8351692-8d1a-4b41-bdaf-bf179786ff59+13:2350:x1875178192737408:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788309594.142756:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788309594.142765:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c8e26d8200/0x63a04852f462862a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a905 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309594.142776:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788309594.142797:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6b29450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f8351692-8d1a-4b41-bdaf-bf179786ff59+12:2350:x1875178192737408:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 50us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309594.142803:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 18 00000100:00100000:2.0:1788309594.142847:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 19 00000100:00100000:2.0:1788309594.142854:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffeb3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f8351692-8d1a-4b41-bdaf-bf179786ff59+11:2350:x1875178192737664:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788309594.142862:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788309594.142870:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c8d73ef000/0x63a04852f46288a0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a9d0 expref: 11 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309594.142886:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788309594.142905:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffeb3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f8351692-8d1a-4b41-bdaf-bf179786ff59+10:2350:x1875178192737664:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 51us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309594.142912:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 19 00000100:00100000:0.0:1788309594.144169:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192737280 00000100:00100000:0.0:1788309594.144180:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192737280 00000100:00100000:0.0:1788309594.144237:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 72 00000100:00100000:0.0:1788309594.144250:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffeb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+7:2349:x1875178192737280:12345-192.168.202.55@tcp:9:umount.0 00000020:00000080:0.0:1788309594.144293:0:6681:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x63a04852f4628bcc 00000020:00010000:0.0:1788309594.144301:0:6681:0:(genops.c:1921:obd_stale_export_put()) Put export ffff97c8d0dae800: total 0 00000100:00080000:0.0:1788309594.144306:0:6681:0:(import.c:65:import_set_state_nolock()) ffff97c8d0daf800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788309594.144344:0:6681:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1788309594.144614:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffeb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+5:2349:x1875178192737280:12345-192.168.202.55@tcp:9:umount.0 Request processed in 368us (2356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309594.144621:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 72 00000020:00010000:0.0:1788309594.144649:0:5825:0:(genops.c:1907:obd_stale_export_get()) Get export ffff97c8d0dae800: total 0 00010000:00010000:0.0:1788309594.144669:0:5825:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff97c8d0dae800, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1788309594.144719:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e54aaad2/0x63a04852f4629606 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad73 expref: 4 pid: 12478 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309594.144751:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bfa15baf/0x63a04852f4628f68 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aba5 expref: 3 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309594.144767:0:5825:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff97c8d0dae800, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1788309594.144778:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309594.144780:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309594.144781:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788309594.144803:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788309594.154359:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309594.154477:0:12478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192737792 00000100:00100000:0.0:1788309594.154487:0:12478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192737792 00000100:00100000:0.0:1788309594.154548:0:12478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 73 00000100:00100000:0.0:1788309594.154559:0:12478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffeb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+5:2349:x1875178192737792:12345-192.168.202.55@tcp:9:umount.0 00000020:00000080:0.0:1788309594.154586:0:12478:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x63a04852f4628964 00000100:00080000:0.0:1788309594.154594:0:12478:0:(import.c:65:import_set_state_nolock()) ffff97c8ecdba800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788309594.154627:0:12478:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1788309594.154860:0:12478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffeb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+2:2349:x1875178192737792:12345-192.168.202.55@tcp:9:umount.0 Request processed in 303us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309594.154868:0:12478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 73 00010000:00010000:3.0:1788309594.154929:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788309594.155186:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788309594.167936:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309594.171885:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192738816 00000100:00100000:2.0:1788309594.171906:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192738816 00000100:00100000:1.0:1788309594.172123:0:8305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 240 00000100:00100000:1.0:1788309594.172215:0:8305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffbb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+23:2349:x1875178192738816:12345-192.168.202.55@tcp:39:umount.0 00000020:00000080:1.0:1788309594.172257:0:8305:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x63a04852f4628600 00000020:00010000:1.0:1788309594.172303:0:8305:0:(genops.c:1921:obd_stale_export_put()) Put export ffff97c8ecf59800: total 0 00000100:00080000:1.0:1788309594.172310:0:8305:0:(import.c:65:import_set_state_nolock()) ffff97c8fc786800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788309594.172454:0:8305:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:1.0:1788309594.172862:0:8305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffbb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86451057-f8bb-4d7c-a7c2-5c834b43e3d3+22:2349:x1875178192738816:12345-192.168.202.55@tcp:39:umount.0 Request processed in 723us (4933us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1788309594.172872:0:8305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 240 00000020:00010000:0.0:1788309594.176095:0:7628:0:(genops.c:1907:obd_stale_export_get()) Get export ffff97c8ecf59800: total 0 00010000:00010000:0.0:1788309594.176228:0:7628:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff97c8ecf59800, canceled 0 locks, left on hash table 14. 00010000:00010000:0.0:1788309594.176267:0:7628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97c8c2ab9600) 00010000:00010000:0.0:1788309594.176272:0:7628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788309594.177208:0:7628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ea00/0x63a04852f46288e6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a9e5 expref: 21 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309594.177248:0:7628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97c8d83f4b00) 00010000:00010000:0.0:1788309594.177252:0:7628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788309594.177257:0:7628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc934800/0x63a04852f46295b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad5e expref: 20 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309594.177272:0:7628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c8d83f4800) 00010000:00010000:0.0:1788309594.177298:0:7628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788309594.177303:0:7628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4628fca lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146abc1 expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309594.177342:0:7628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97c8d83f4b00) 00010000:00010000:0.0:1788309594.177345:0:7628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788309594.177349:0:7628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8fc935600/0x63a04852f46295f1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad6c expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309594.177362:0:7628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97c8d83f4100) 00010000:00010000:0.0:1788309594.177365:0:7628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788309594.177369:0:7628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548c00/0x63a04852f4628f29 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab90 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309594.177484:0:7628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97c8d83f4100) 00010000:00010000:0.0:1788309594.177487:0:7628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788309594.177492:0:7628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8000/0x63a04852f4628f53 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab9e expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309594.177507:0:7628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97c8d832f200) 00010000:00010000:0.0:1788309594.177509:0:7628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788309594.177513:0:7628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f46292c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ac9a expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309594.177526:0:7628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97c8d832f400) 00010000:00010000:0.0:1788309594.177529:0:7628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788309594.177533:0:7628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8a00/0x63a04852f4628c27 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aacc expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309594.177545:0:7628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff97c8c3d81e00) 00010000:00010000:0.0:1788309594.177547:0:7628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788309594.177558:0:7628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73efe00/0x63a04852f46288ca lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a9de expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309594.177581:0:7628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97c8d832f200) 00010000:00010000:0.0:1788309594.177584:0:7628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788309594.177588:0:7628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548600/0x63a04852f4628fe6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146abc8 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309594.177603:0:7628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97c8d83f4100) 00010000:00010000:0.0:1788309594.177606:0:7628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788309594.177610:0:7628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548a00/0x63a04852f4628e49 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ab58 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309594.177624:0:7628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97c8d832f400) 00010000:00010000:0.0:1788309594.177626:0:7628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788309594.177630:0:7628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549600/0x63a04852f462893a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a9fa expref: 10 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309594.177644:0:7628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97c8d83f4b00) 00010000:00010000:0.0:1788309594.177647:0:7628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788309594.177651:0:7628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c153a000/0x63a04852f46294e7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad26 expref: 9 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309594.177663:0:7628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97c8d83f4b00) 00010000:00010000:0.0:1788309594.177666:0:7628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788309594.177670:0:7628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f200/0x63a04852f46295e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad65 expref: 8 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309594.177686:0:7628:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff97c8ecf59800, canceled 14 locks, left on hash table 0. 00010000:00010000:0.0:1788309594.177713:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309594.177716:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309594.177718:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788309594.598954:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3301:1875178210542592:0@lo:400:kworker.0 00000100:00100000:3.0:1788309594.599043:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309594.599095:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e6586d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875178210543104:0@lo:400:kworker.0 00000100:00100000:3.0:1788309594.599125:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309594.599149:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788309594.599155:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e6584000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210542976:0@lo:400:kworker.0 00000100:00100000:3.0:1788309594.599199:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309594.601970:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875178210542720:0@lo:400:kworker.0 00000100:00100000:2.0:1788309594.602063:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309594.602104:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e667f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875178210543232:0@lo:400:kworker.0 00000100:00100000:2.0:1788309594.602130:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309594.602164:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788309594.602171:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875178210542848:0@lo:400:kworker.0 00000100:00100000:2.0:1788309594.602196:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309594.602236:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210542592 00000100:00100000:2.0:1788309594.602245:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210542592 00000100:00100000:2.0:1788309594.602326:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1788309594.602337:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6a6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:3301:x1875178210542592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309594.602394:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6a6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:3301:x1875178210542592:12345-0@lo:400:kworker.0 Request processed in 59us (3351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309594.602401:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1788309594.602435:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210543104 00000100:00100000:2.0:1788309594.602438:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210543104 00000100:00100000:2.0:1788309594.602467:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210542720 00000100:00100000:2.0:1788309594.602470:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210542720 00000100:00100000:2.0:1788309594.602481:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210542848 00000100:00100000:2.0:1788309594.602491:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210542848 00000100:00100000:2.0:1788309594.602509:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788309594.602515:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8efc4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875178210543104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309594.602551:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8efc4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875178210543104:12345-0@lo:400:kworker.0 Request processed in 36us (3425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309594.602558:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788309594.602570:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788309594.602577:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffeb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875178210542720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309594.602610:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffeb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875178210542720:12345-0@lo:400:kworker.0 Request processed in 32us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309594.602615:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788309594.602628:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788309594.602634:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffeb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875178210542848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309594.602661:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffeb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875178210542848:12345-0@lo:400:kworker.0 Request processed in 28us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309594.602667:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788309594.602687:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210542976 00000100:00100000:2.0:1788309594.602690:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210542976 00000100:00100000:2.0:1788309594.602718:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210543232 00000100:00100000:2.0:1788309594.602721:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210543232 00000100:00100000:2.0:1788309594.602743:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788309594.602750:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc575180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875178210542976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309594.602782:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc575180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875178210542976:12345-0@lo:400:kworker.0 Request processed in 33us (3583us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309594.602788:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788309594.602799:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788309594.602805:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffeb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875178210543232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309594.602845:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffeb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875178210543232:12345-0@lo:400:kworker.0 Request processed in 40us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309594.602852:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788309594.602919:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875178210542848:0@lo:400:kworker.0 00000100:00100000:2.0:1788309594.602932:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875178210542720:0@lo:400:kworker.0 00000100:00100000:2.0:1788309594.602942:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e667f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875178210543232:0@lo:400:kworker.0 00000100:00100000:2.0:1788309594.602977:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e6584000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210542976:0@lo:400:kworker.0 00000100:00100000:2.0:1788309594.602987:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3301:1875178210542592:0@lo:400:kworker.0 00000100:00100000:2.0:1788309594.602998:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e6586d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875178210543104:0@lo:400:kworker.0 00000100:00080000:1.0:1788309594.603129:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788309594.603134:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788309594.603137:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:2.0:1788309594.649321:0:5859:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 86451057-f8bb-4d7c-a7c2-5c834b43e3d3 00000001:00080000:2.0:1788309594.649339:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:2.0:1788309594.649365:0:5859:0:(genops.c:885:class_export_put()) final put ffff97c8ecf59800/86451057-f8bb-4d7c-a7c2-5c834b43e3d3 00000020:00000080:3.0:1788309594.649522:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff97c8ecf59800/86451057-f8bb-4d7c-a7c2-5c834b43e3d3 for lustre-MDT0000 00000020:00000080:3.0:1788309594.649588:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97c8fc786800 for lustre-MDT0000 00000001:00100000:0.0:1788309594.661907:0:7639:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 86451057-f8bb-4d7c-a7c2-5c834b43e3d3 00000020:00000080:0.0:1788309594.661982:0:7639:0:(genops.c:885:class_export_put()) final put ffff97c8d0dae800/86451057-f8bb-4d7c-a7c2-5c834b43e3d3 00000020:00000080:1.0:1788309594.662064:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff97c8d0dae800/86451057-f8bb-4d7c-a7c2-5c834b43e3d3 for lustre-OST0001 00000020:00000080:1.0:1788309594.662134:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97c8d0daf800 for lustre-OST0001 00010000:00010000:1.0:1788309594.848878:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788309595.075833:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309595.075878:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309595.075989:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192738944 00000100:00100000:0.0:1788309595.076000:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192738944 00000100:00100000:3.0:1788309595.076040:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192739072 00000100:00100000:3.0:1788309595.076055:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192739072 00000100:00100000:0.0:1788309595.076172:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 304 00000100:00100000:0.0:1788309595.076195:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6a6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8351692-8d1a-4b41-bdaf-bf179786ff59+10:2352:x1875178192738944:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788309595.076200:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 169 00000100:00100000:3.0:1788309595.076225:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffeb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ea7f0717-c12d-4408-bdfd-5a035f695b73+6:2352:x1875178192739072:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788309595.076346:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6a6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8351692-8d1a-4b41-bdaf-bf179786ff59+10:2352:x1875178192738944:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 158us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309595.076357:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 304 00000100:00100000:3.0:1788309595.076380:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffeb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ea7f0717-c12d-4408-bdfd-5a035f695b73+6:2352:x1875178192739072:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 151us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309595.076390:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 169 00000100:00080000:1.0:1788309595.079364:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788309595.104536:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffeb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210543360:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788309595.104602:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309595.107506:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210543360 00000100:00100000:1.0:1788309595.107543:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210543360 00000100:00100000:1.0:1788309595.107627:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788309595.107642:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffbb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210543360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788309595.107698:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788309595.107826:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffbb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210543360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 188us (3222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309595.107836:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788309595.108036:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffeb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210543360:0@lo:13:osp-pre-1-0.0 00000001:00100000:0.0:1788309595.150794:0:6706:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 86451057-f8bb-4d7c-a7c2-5c834b43e3d3 00000020:00000080:0.0:1788309595.150804:0:6706:0:(genops.c:885:class_export_put()) final put ffff97c8ecdb9000/86451057-f8bb-4d7c-a7c2-5c834b43e3d3 00000020:00000080:1.0:1788309595.150922:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff97c8ecdb9000/86451057-f8bb-4d7c-a7c2-5c834b43e3d3 for lustre-OST0000 00000020:00000080:1.0:1788309595.151004:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97c8ecdba800 for lustre-OST0000 00000100:00100000:2.0:1788309595.616703:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788309595.616745:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc575f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210543488:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788309595.616879:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309595.617215:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210543488 00000100:00100000:1.0:1788309595.617234:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210543488 00000100:00100000:1.0:1788309595.617396:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788309595.617409:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffeb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875178210543488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788309595.617459:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788309595.617571:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffeb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875178210543488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 166us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309595.617578:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788309595.617713:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc575f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210543488:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788309595.872754:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788309596.075126:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309596.075302:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192739200 00000100:00100000:0.0:1788309596.075317:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192739200 00000100:00100000:0.0:1788309596.075418:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 20 00000100:00100000:0.0:1788309596.075432:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffeb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f8351692-8d1a-4b41-bdaf-bf179786ff59+10:2352:x1875178192739200:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788309596.075454:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788309596.075482:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c8d73eea00/0x63a04852f46286d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a91a expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309596.075516:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788309596.075601:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffeb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f8351692-8d1a-4b41-bdaf-bf179786ff59+9:2352:x1875178192739200:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 171us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309596.075629:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 20 00000100:00100000:3.0:1788309596.079884:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309596.080007:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309596.080233:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192739328 00000100:00100000:1.0:1788309596.080247:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192739328 00000100:00100000:1.0:1788309596.080379:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192739456 00000100:00100000:1.0:1788309596.080382:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192739456 00000100:00100000:1.0:1788309596.080417:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 21 00000100:00100000:1.0:1788309596.080429:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc574e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f8351692-8d1a-4b41-bdaf-bf179786ff59+10:2353:x1875178192739328:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788309596.080448:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788309596.080474:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c8e26d9e00/0x63a04852f46286d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a944 expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309596.080535:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788309596.080606:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc574e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f8351692-8d1a-4b41-bdaf-bf179786ff59+9:2353:x1875178192739328:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 178us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309596.080614:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 21 00000100:00100000:1.0:1788309596.080632:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 22 00000100:00100000:1.0:1788309596.080638:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc577100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f8351692-8d1a-4b41-bdaf-bf179786ff59+8:2352:x1875178192739456:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788309596.080646:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788309596.080655:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c8e26d9800/0x63a04852f4628899 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a9c9 expref: 8 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309596.080664:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788309596.080683:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc577100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f8351692-8d1a-4b41-bdaf-bf179786ff59+7:2352:x1875178192739456:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 45us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309596.080689:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 22 00000100:00100000:3.0:1788309596.095100:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309596.095526:0:8305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192739712 00000100:00100000:1.0:1788309596.095543:0:8305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192739712 00000100:00100000:1.0:1788309596.095636:0:8305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 241 00000100:00100000:1.0:1788309596.095651:0:8305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc576d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ea7f0717-c12d-4408-bdfd-5a035f695b73+6:2349:x1875178192739712:12345-192.168.202.55@tcp:39:umount.0 00000020:00000080:1.0:1788309596.095712:0:8305:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x63a04852f46286e7 00000020:00010000:1.0:1788309596.095726:0:8305:0:(genops.c:1921:obd_stale_export_put()) Put export ffff97c8eff06800: total 0 00000100:00080000:1.0:1788309596.095732:0:8305:0:(import.c:65:import_set_state_nolock()) ffff97c8eff03800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788309596.095779:0:8305:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:1.0:1788309596.096416:0:8305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc576d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ea7f0717-c12d-4408-bdfd-5a035f695b73+5:2349:x1875178192739712:12345-192.168.202.55@tcp:39:umount.0 Request processed in 764us (1330us total) trans 4294967526 rc 0/0 00000100:00100000:1.0:1788309596.096425:0:8305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 241 00000020:00010000:0.0:1788309596.098384:0:7627:0:(genops.c:1907:obd_stale_export_get()) Get export ffff97c8eff06800: total 0 00010000:00010000:0.0:1788309596.098483:0:7627:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff97c8eff06800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788309596.098553:0:7627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c8d83f4800) 00010000:00010000:0.0:1788309596.098558:0:7627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788309596.098575:0:7627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f000/0x63a04852f4629614 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad7a expref: 4 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309596.098613:0:7627:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff97c8eff06800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1788309596.098628:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309596.098631:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309596.098633:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788309596.125404:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309596.125647:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192739968 00000100:00100000:2.0:1788309596.125663:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192739968 00000100:00100000:2.0:1788309596.125743:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 305 00000100:00100000:2.0:1788309596.125758:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6a6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8351692-8d1a-4b41-bdaf-bf179786ff59+7:2349:x1875178192739968:12345-192.168.202.55@tcp:251:umount.0 00000020:00000080:2.0:1788309596.125844:0:5832:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x63a04852f46285dd 00000020:00010000:2.0:1788309596.125856:0:5832:0:(genops.c:1921:obd_stale_export_put()) Put export ffff97c8fc783000: total 0 00000100:00080000:2.0:1788309596.125862:0:5832:0:(import.c:65:import_set_state_nolock()) ffff97c8fc782000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788309596.126059:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6a6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8351692-8d1a-4b41-bdaf-bf179786ff59+3:2349:x1875178192739968:12345-192.168.202.55@tcp:251:umount.0 Request processed in 301us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309596.126069:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 305 00000020:00010000:3.0:1788309596.126226:0:7628:0:(genops.c:1907:obd_stale_export_get()) Get export ffff97c8fc783000: total 0 00010000:00010000:3.0:1788309596.126232:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309596.126318:0:7628:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff97c8fc783000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788309596.126377:0:7628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c8d73eec00/0x63a04852f4628631 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146a90c expref: 2 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309596.126401:0:7628:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff97c8fc783000, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1788309596.126412:0:7628:0:(genops.c:885:class_export_put()) final put ffff97c8fc783000/f8351692-8d1a-4b41-bdaf-bf179786ff59 00010000:00010000:3.0:1788309596.126426:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309596.126428:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309596.126430:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788309596.126440:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff97c8fc783000/f8351692-8d1a-4b41-bdaf-bf179786ff59 for MGS 00000020:00000080:3.0:1788309596.126486:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97c8fc782000 for MGS 00010000:00010000:3.0:1788309596.897618:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309597.923649:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788309598.561529:0:12959:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1788309598.593189:0:12959:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1788309598.593255:0:12959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8d73ee200/0x63a04852f4628670 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4628677 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309598.593274:0:12959:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8d73ee200/0x63a04852f4628670 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x63a04852f4628677 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309598.593364:0:12959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8d73ee200/0x63a04852f4628670 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x63a04852f4628677 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309598.593372:0:12959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.155@tcp lock: ffff97c8d73ee200/0x63a04852f4628670 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x63a04852f4628677 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309598.593391:0:12959:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788309598.593397:0:12959:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788309598.593423:0:12959:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788309598.593427:0:12959:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788309598.593448:0:12959:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788309598.593476:0:12959:0:(import.c:65:import_set_state_nolock()) ffff97c8ec6c7000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788309598.593531:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffbb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875178210543616:0@lo:39:umount.0 00000100:00100000:2.0:1788309598.593608:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788309598.593715:0:7627:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788309598.593723:0:7627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff97c8d73ee200/0x63a04852f4628670 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x63a04852f4628677 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309598.593730:0:7627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8d73ee200 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:3.0:1788309598.593741:0:7627:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff97c8d73ee200/0x63a04852f4628670 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x63a04852f4628677 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309598.593751:0:7627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff97c8d73ee200/0x63a04852f4628670 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x63a04852f4628677 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788309598.593759:0:7627:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff97c8d73ee200/0x63a04852f4628670 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x63a04852f4628677 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788309598.593765:0:7627:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788309598.593767:0:7627:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788309598.593769:0:7627:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788309598.593805:0:7627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff97c8d73ee200/0x63a04852f4628670 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x63a04852f4628677 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309598.593811:0:7627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788309598.593833:0:7627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff97c8d73ee200/0x63a04852f4628670 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x63a04852f4628677 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309598.593839:0:7627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff97c8d73ee200/0x63a04852f4628670 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x63a04852f4628677 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309598.593853:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309598.593855:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309598.593856:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788309598.593867:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788309598.593880:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc576680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3300:1875178210543744:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788309598.593916:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309598.594044:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210543744 00000100:00100000:0.0:1788309598.594054:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210543744 00000100:00100000:0.0:1788309598.594122:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788309598.594133:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc577480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:3300:x1875178210543744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788309598.594146:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788309598.594164:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c8f5549400/0x63a04852f4628677 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x63a04852f4628670 expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309598.594180:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788309598.594221:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc577480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00707c3b-bc67-4313-a42d-1f5d185ea5d5+18:3300:x1875178210543744:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309598.594228:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788309598.594264:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210543616 00000100:00100000:0.0:1788309598.594268:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210543616 00000100:00100000:0.0:1788309598.594334:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1788309598.594341:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6586d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875178210543616:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788309598.594367:0:5839:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x63a04852f46283ec 00000100:00080000:0.0:1788309598.594375:0:5839:0:(import.c:65:import_set_state_nolock()) ffff97c8ed049000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788309598.597201:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788309598.597264:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc576680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3300:1875178210543744:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788309598.607511:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6586d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3299:x1875178210543616:12345-0@lo:39:umount.0 Request processed in 13159us (13891us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309598.607526:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:0.0:1788309598.607542:0:5839:0:(genops.c:885:class_export_put()) final put ffff97c8ed04b000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788309598.607808:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff97c8ed04b000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788309598.607904:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97c8ed049000 for lustre-MDT0000 00000100:00080000:2.0:1788309598.609450:0:3299:0:(import.c:65:import_set_state_nolock()) ffff97c8ec6c7000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788309598.609479:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffbb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875178210543616:0@lo:39:umount.0 00000100:00080000:0.0:1788309598.609572:0:12959:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788309598.609577:0:12959:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788309598.609582:0:12959:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788309598.611594:0:12959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8f5549a00/0x63a04852f462867e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4628685 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309598.611627:0:12959:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8f5549a00/0x63a04852f462867e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x63a04852f4628685 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309598.611635:0:12959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8f5549a00/0x63a04852f462867e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x63a04852f4628685 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309598.611641:0:12959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.155@tcp lock: ffff97c8f5549a00/0x63a04852f462867e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x63a04852f4628685 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309598.611786:0:12959:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788309598.611998:0:12959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8e26d9200/0x63a04852f4628597 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f462859e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309598.612007:0:12959:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8e26d9200/0x63a04852f4628597 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x63a04852f462859e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309598.612013:0:12959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8e26d9200/0x63a04852f4628597 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x63a04852f462859e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309598.612019:0:12959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.155@tcp lock: ffff97c8e26d9200/0x63a04852f4628597 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x63a04852f462859e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309598.612055:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788309598.612063:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff97c8f5549a00/0x63a04852f462867e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x63a04852f4628685 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309598.612071:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8f5549a00 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:3.0:1788309598.612075:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff97c8f5549a00/0x63a04852f462867e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x63a04852f4628685 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309598.612097:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff97c8f5549a00/0x63a04852f462867e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x63a04852f4628685 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788309598.612105:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff97c8f5549a00/0x63a04852f462867e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x63a04852f4628685 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788309598.612111:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788309598.612113:0:5824:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1788309598.616963:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff97c8f5549a00/0x63a04852f462867e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x63a04852f4628685 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309598.616982:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788309598.617031:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff97c8f5549a00/0x63a04852f462867e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x63a04852f4628685 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309598.617039:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff97c8f5549a00/0x63a04852f462867e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x63a04852f4628685 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309598.617054:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788309598.617058:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff97c8e26d9200/0x63a04852f4628597 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x63a04852f462859e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309598.617079:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d9200 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:3.0:1788309598.617096:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff97c8e26d9200/0x63a04852f4628597 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x63a04852f462859e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309598.617105:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff97c8e26d9200/0x63a04852f4628597 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x63a04852f462859e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788309598.617112:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff97c8e26d9200/0x63a04852f4628597 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x63a04852f462859e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788309598.617117:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788309598.617120:0:5824:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:3.0:1788309598.617141:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff97c8e26d9200/0x63a04852f4628597 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x63a04852f462859e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309598.617150:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788309598.617157:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff97c8e26d9200/0x63a04852f4628597 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x63a04852f462859e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309598.617164:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309598.617165:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309598.617168:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788309598.617327:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc574380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3303:1875178210544000:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788309598.617407:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309598.617474:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788309598.617480:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc576680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3303:1875178210543872:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788309598.617504:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309598.617537:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210544000 00000100:00100000:1.0:1788309598.617545:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210544000 00000100:00100000:1.0:1788309598.617594:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210543872 00000100:00100000:1.0:1788309598.617598:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210543872 00000100:00100000:1.0:1788309598.617623:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788309598.617632:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecb41180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+19:3303:x1875178210544000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788309598.617646:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788309598.617661:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c8f5548200/0x63a04852f462859e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x63a04852f4628597 expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309598.617677:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788309598.617714:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecb41180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+18:3303:x1875178210544000:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309598.617722:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788309598.617738:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788309598.617744:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6b2b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+17:3303:x1875178210543872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788309598.617751:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788309598.617761:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c8f5549c00/0x63a04852f4628685 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x63a04852f462867e expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309598.617769:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788309598.617790:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6b2b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+16:3303:x1875178210543872:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309598.617805:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788309598.617865:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc576680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3303:1875178210543872:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788309598.617873:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc574380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3303:1875178210544000:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788309598.618180:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309598.618207:0:12959:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788309598.618217:0:12959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff97c8e26d9200/0x63a04852f4628597 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x63a04852f462859e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788309598.618233:0:12959:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1788309598.618255:0:12959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c9021e4600/0x63a04852f462888b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4628892 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309598.618263:0:12959:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c9021e4600/0x63a04852f462888b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x63a04852f4628892 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309598.618270:0:12959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c9021e4600/0x63a04852f462888b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x63a04852f4628892 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309598.618392:0:12959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.155@tcp lock: ffff97c9021e4600/0x63a04852f462888b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x63a04852f4628892 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309598.618439:0:12959:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788309598.618446:0:12959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8e26d9000/0x63a04852f462834b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4628352 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309598.618452:0:12959:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8e26d9000/0x63a04852f462834b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x63a04852f4628352 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309598.618458:0:12959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8e26d9000/0x63a04852f462834b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x63a04852f4628352 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309598.618465:0:12959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.155@tcp lock: ffff97c8e26d9000/0x63a04852f462834b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x63a04852f4628352 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309598.620387:0:7627:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788309598.620406:0:7627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff97c9021e4600/0x63a04852f462888b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x63a04852f4628892 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309598.620419:0:7627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c9021e4600 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:3.0:1788309598.620425:0:7627:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff97c9021e4600/0x63a04852f462888b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x63a04852f4628892 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309598.620453:0:7627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff97c9021e4600/0x63a04852f462888b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x63a04852f4628892 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788309598.620461:0:7627:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff97c9021e4600/0x63a04852f462888b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x63a04852f4628892 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788309598.620468:0:7627:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788309598.620470:0:7627:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788309598.620473:0:7627:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788309598.620516:0:7627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff97c9021e4600/0x63a04852f462888b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x63a04852f4628892 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309598.620523:0:7627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788309598.620654:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:3.0:1788309598.620675:0:7627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff97c9021e4600/0x63a04852f462888b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x63a04852f4628892 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309598.620683:0:7627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff97c9021e4600/0x63a04852f462888b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x63a04852f4628892 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309598.620699:0:7627:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788309598.620703:0:7627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff97c8e26d9000/0x63a04852f462834b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x63a04852f4628352 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309598.620709:0:7627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d9000 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:3.0:1788309598.620712:0:7627:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff97c8e26d9000/0x63a04852f462834b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x63a04852f4628352 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309598.620720:0:7627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff97c8e26d9000/0x63a04852f462834b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x63a04852f4628352 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788309598.620739:0:7627:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff97c8e26d9000/0x63a04852f462834b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x63a04852f4628352 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788309598.620745:0:7627:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788309598.620747:0:7627:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:3.0:1788309598.620761:0:7627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff97c8e26d9000/0x63a04852f462834b lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x63a04852f4628352 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309598.620766:0:7627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788309598.620829:0:12959:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 10000000:01000000:2.0:1788309598.620839:0:12959:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 10000000:01000000:2.0:1788309598.620846:0:12959:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1788309598.620848:0:12959:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1788309598.620890:0:12959:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1788309598.620894:0:12959:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1788309598.620905:0:12959:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788309598.620910:0:12959:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:2.0:1788309598.620918:0:12959:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff97c8ee5cd800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788309598.620924:0:12959:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff97c8ffc74800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788309598.620931:0:12959:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff97c8eff06800 ea7f0717-c12d-4408-bdfd-5a035f695b73 192.168.202.55@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788309598.620936:0:12959:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff97c8e6448000) has exports, disconnecting them 00000020:00080000:2.0:1788309598.620941:0:12959:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff97c8ee5cd800), last request at 1788309594 00000020:00000080:2.0:1788309598.620950:0:12959:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x63a04852f462855f 00000100:00080000:2.0:1788309598.620970:0:12959:0:(import.c:65:import_set_state_nolock()) ffff97c8ee5cf000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788309598.621040:0:12959:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff97c8ee5cd800): rc 0 00000020:00000080:2.0:1788309598.621043:0:12959:0:(genops.c:885:class_export_put()) final put ffff97c8ee5cd800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1788309598.621052:0:12959:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff97c8ffc74800), last request at 1788309594 00000020:00000080:2.0:1788309598.621055:0:12959:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x63a04852f4628494 00000100:00080000:2.0:1788309598.621060:0:12959:0:(import.c:65:import_set_state_nolock()) ffff97c8ffc73800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788309598.621071:0:12959:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff97c8ffc74800): rc 0 00000020:00000080:2.0:1788309598.621073:0:12959:0:(genops.c:885:class_export_put()) final put ffff97c8ffc74800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:2.0:1788309598.621096:0:12959:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbd5e00e33ae0 00000100:00080000:2.0:1788309598.621121:0:12959:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788309598.621125:0:12959:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:2.0:1788309598.621139:0:12959:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788309598.621204:0:12959:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788309598.621220:0:12959:0:(import.c:65:import_set_state_nolock()) ffff97c8e6954800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788309598.621233:0:12959:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788309598.621235:0:12959:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:2.0:1788309598.621243:0:12959:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788309598.621353:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e6584000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875178210544384:0@lo:9:umount.0 00000100:00100000:2.0:1788309598.621444:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788309598.621510:0:12959:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788309598.621524:0:12959:0:(import.c:65:import_set_state_nolock()) ffff97c8f5556000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1788309598.621557:0:12959:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff97c8e6448000) has no exports 00000100:00100000:2.0:1788309598.621578:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875178210544512:0@lo:9:umount.0 00000100:00100000:2.0:1788309598.621604:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309598.621633:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210544384 00000100:00100000:2.0:1788309598.621639:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210544384 00000100:00100000:2.0:1788309598.621695:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210544512 00000100:00100000:2.0:1788309598.621698:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210544512 00000100:00100000:2.0:1788309598.621722:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788309598.621731:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e667f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1875178210544384:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788309598.621755:0:6682:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x63a04852f46284e1 00000100:00080000:2.0:1788309598.621761:0:6682:0:(import.c:65:import_set_state_nolock()) ffff97c8efc16000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788309598.621789:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1788309598.622160:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e667f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3299:x1875178210544384:12345-0@lo:9:umount.0 Request processed in 429us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309598.622168:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788309598.622186:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788309598.622193:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8eff0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1875178210544512:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788309598.622205:0:6682:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x63a04852f46285d6 00000100:00080000:2.0:1788309598.622211:0:6682:0:(import.c:65:import_set_state_nolock()) ffff97c8fc785000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788309598.622226:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1788309598.622446:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8eff0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3299:x1875178210544512:12345-0@lo:9:umount.0 Request processed in 254us (840us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309598.622453:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1788309598.622502:0:3299:0:(import.c:65:import_set_state_nolock()) ffff97c8f5556000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788309598.622516:0:3299:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788309598.622518:0:3299:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788309598.622531:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875178210544512:0@lo:9:umount.0 00000100:00080000:2.0:1788309598.622548:0:3299:0:(import.c:65:import_set_state_nolock()) ffff97c8e6954800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788309598.622551:0:3299:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788309598.622552:0:3299:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788309598.622553:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e6584000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875178210544384:0@lo:9:umount.0 00010000:00010000:2.0:1788309598.622599:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309598.622602:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309598.622605:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788309598.623040:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff97c8ee5cd800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1788309598.623087:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff97c8ffc74800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788309598.623112:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97c8ee5cf000 for lustre-MDT0000 00000020:00000080:0.0:1788309598.623116:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97c8ffc73800 for lustre-MDT0000 00000100:00100000:0.0:1788309598.623211:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788309598.623227:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc577800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3300:1875178210544256:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788309598.623268:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788309598.626754:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788309598.626763:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788309598.626837:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc576a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3301:1875178210544128:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788309598.626912:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309598.626982:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210544256 00000100:00100000:1.0:1788309598.627001:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210544256 00000100:00100000:1.0:1788309598.627058:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210544128 00000100:00100000:1.0:1788309598.627062:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210544128 00000100:00100000:1.0:1788309598.627094:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788309598.627102:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffbb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+17:3300:x1875178210544256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788309598.627114:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788309598.627130:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c9021e5a00/0x63a04852f4628352 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x63a04852f462834b expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309598.627148:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788309598.627184:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffbb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+16:3300:x1875178210544256:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (3914us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309598.627191:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788309598.627207:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788309598.627214:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecb41180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+15:3301:x1875178210544128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788309598.627221:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788309598.627229:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c8f5549e00/0x63a04852f4628892 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x63a04852f462888b expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309598.627252:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788309598.627273:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecb41180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+14:3301:x1875178210544128:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309598.627295:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788309598.627327:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc577800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3300:1875178210544256:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788309598.627345:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc576a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3301:1875178210544128:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788309598.629602:0:7627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff97c8e26d9000/0x63a04852f462834b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x63a04852f4628352 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309598.629621:0:7627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff97c8e26d9000/0x63a04852f462834b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x63a04852f4628352 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309598.629663:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309598.629665:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309598.629668:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788309598.638702:0:12959:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff97c8e6448000) has no exports 00000020:00000080:0.0:1788309598.776685:0:12959:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x63a04852f46283a6 00000020:00000080:0.0:1788309598.776704:0:12959:0:(genops.c:885:class_export_put()) final put ffff97c8fc746000/lustre-QMT0000_UUID 00000020:01000000:0.0:1788309598.777113:0:12959:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1788309598.777252:0:12959:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788309598.777265:0:12959:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788309598.777270:0:12959:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff97c8d6bd4d28) has no exports 00000020:00000080:3.0:1788309598.777939:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff97c8fc746000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1788309598.778837:0:12959:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x63a04852f462839f 00000020:00000080:1.0:1788309598.778918:0:12959:0:(genops.c:885:class_export_put()) final put ffff97c8edcdb800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788309598.778980:0:12959:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788309598.779001:0:12959:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788309598.779004:0:12959:0:(genops.c:885:class_export_put()) final put ffff97c8edcd9800/lustre-QMT0000_UUID 00000020:00000080:1.0:1788309598.779007:0:12959:0:(genops.c:844:class_export_destroy()) destroying export ffff97c8edcd9800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1788309598.779018:0:12959:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:3.0:1788309598.779691:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff97c8edcdb800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:2.0:1788309598.944481:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788309599.721887:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecb40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875178210544768:0@lo:400:kworker.0 00000100:00100000:1.0:1788309599.721967:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309599.722928:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecb41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3302:1875178210544640:0@lo:400:kworker.0 00000100:00100000:2.0:1788309599.723319:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecb43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875178210544896:0@lo:400:kworker.0 00000100:00100000:1.0:1788309599.731998:0:8305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210544768 00000100:00100000:1.0:1788309599.732012:0:8305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210544768 00000100:00100000:3.0:1788309599.732070:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309599.732076:0:8305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788309599.732088:0:8305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecb42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3303:x1875178210544768:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788309599.732100:0:8305:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788309599.732164:0:8305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecb42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3303:x1875178210544768:12345-0@lo:400:kworker.0 Request processed in 78us (10196us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788309599.732171:0:8305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788309599.732194:0:8305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210544896 00000100:00100000:1.0:1788309599.732198:0:8305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210544896 00000100:00100000:1.0:1788309599.732217:0:8305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1788309599.732221:0:8305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc575500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3300:x1875178210544896:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788309599.732226:0:8305:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788309599.732254:0:8305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc575500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3300:x1875178210544896:12345-0@lo:400:kworker.0 Request processed in 31us (189us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788309599.732259:0:8305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:1.0:1788309599.732480:0:3303:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788309599.732485:0:3303:0:(import.c:65:import_set_state_nolock()) ffff97c8d123d800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788309599.732488:0:3303:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788309599.734764:0:3300:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788309599.734772:0:3300:0:(import.c:65:import_set_state_nolock()) ffff97c8fc782800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788309599.734777:0:3300:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788309599.734782:0:3300:0:(import.c:65:import_set_state_nolock()) ffff97c8fc782800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788309599.734787:0:3300:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 174 00000100:00080000:3.0:1788309599.734795:0:3300:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff97c8fc782800 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:3.0:1788309599.734834:0:3300:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97c8fc574700 x1875178210545024/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788309599.734862:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecb43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875178210544896:0@lo:400:kworker.0 00000100:00100000:3.0:1788309599.736529:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc574700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3299:1875178210545024:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1788309599.736625:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309599.741524:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309599.741808:0:8305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210545024 00000100:00100000:0.0:1788309599.741820:0:8305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210545024 00000100:00100000:0.0:1788309599.741889:0:8305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1788309599.741897:0:8305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc577b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3299:x1875178210545024:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:0.0:1788309599.741917:0:8305:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788309599.749818:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210544640 00000100:00100000:3.0:1788309599.749833:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210544640 00000100:00100000:3.0:1788309599.749901:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1788309599.749913:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6a6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+14:3302:x1875178210544640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309599.750033:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6a6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:00707c3b-bc67-4313-a42d-1f5d185ea5d5+14:3302:x1875178210544640:12345-0@lo:400:kworker.0 Request processed in 122us (8517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309599.750041:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1788309599.750106:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecb41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3302:1875178210544640:0@lo:400:kworker.0 00000100:00100000:0.0:1788309599.758021:0:8305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc577b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3299:x1875178210545024:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 16108us (21382us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788309599.758043:0:8305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:2.0:1788309599.759388:0:3299:0:(import.c:65:import_set_state_nolock()) ffff97c8fc782800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788309599.759402:0:3299:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788309599.759408:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc574700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3299:1875178210545024:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:1.0:1788309599.764725:0:3303:0:(import.c:65:import_set_state_nolock()) ffff97c8d123d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788309599.764741:0:3303:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 153 00000100:00080000:1.0:1788309599.764753:0:3303:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff97c8d123d800 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:0.0:1788309599.765127:0:3303:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97c8ffbb1880 x1875178210545152/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788309599.765159:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecb40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875178210544768:0@lo:400:kworker.0 00000100:00100000:0.0:1788309599.765642:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffbb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3299:1875178210545152:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1788309599.765714:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309599.765776:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210545152 00000100:00100000:0.0:1788309599.765785:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210545152 00000100:00100000:0.0:1788309599.765825:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1788309599.765834:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffbb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3299:x1875178210545152:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:0.0:1788309599.765855:0:5838:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788309599.765898:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffbb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3299:x1875178210545152:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 63us (183us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788309599.765904:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:0.0:1788309599.765944:0:3299:0:(import.c:65:import_set_state_nolock()) ffff97c8d123d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788309599.765949:0:3299:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788309599.765952:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffbb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3299:1875178210545152:0@lo:38:ptlrpcd_00_03.0 00000001:00100000:3.0:1788309599.789997:0:5859:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ea7f0717-c12d-4408-bdfd-5a035f695b73 00000001:00080000:3.0:1788309599.790016:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:3.0:1788309599.790022:0:5859:0:(genops.c:885:class_export_put()) final put ffff97c8eff06800/ea7f0717-c12d-4408-bdfd-5a035f695b73 00000020:00000080:3.0:1788309599.790044:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff97c8eff06800/ea7f0717-c12d-4408-bdfd-5a035f695b73 for lustre-MDT0000 00000020:00000080:3.0:1788309599.790098:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97c8eff03800 for lustre-MDT0000 00000001:00100000:3.0:1788309599.790702:0:7639:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788309599.790707:0:7639:0:(genops.c:885:class_export_put()) final put ffff97c8fc780800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788309599.790815:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff97c8fc780800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788309599.790856:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97c8fc785000 for lustre-OST0001 00010000:00010000:2.0:1788309599.971343:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788309600.249197:0:6706:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788309600.249207:0:6706:0:(genops.c:885:class_export_put()) final put ffff97c8efc15800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788309600.249438:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff97c8efc15800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788309600.249555:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97c8efc16000 for lustre-OST0000 00000020:01000000:1.0:1788309600.800668:0:12959:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff97c8f54d5f00 - data ffff97c8faee5ca8/ffff97c8f52a1400 00000020:01000000:1.0:1788309600.800840:0:12959:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff97c8e0717000 - data ffff97c8dfa3fe58/ffff97c8e69dfc00 00000001:00000004:1.0:1788309600.813558:0:12959:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:2.0:1788309600.907058:0:12959:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788309600.907067:0:12959:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1788309600.907253:0:12959:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788309600.907257:0:12959:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788309600.909232:0:6901:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788309600.909240:0:6901:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:0.0:1788309600.909251:0:6901:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1788309600.910713:0:12959:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788309600.910720:0:12959:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1788309600.910743:0:12959:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788309600.910746:0:12959:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788309600.914798:0:8087:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788309600.914807:0:8087:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:0.0:1788309600.914824:0:8087:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00010000:00010000:2.0:1788309600.995941:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788309601.044693:0:12959:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x63a04852f462836e 00000020:00000080:1.0:1788309601.044708:0:12959:0:(genops.c:885:class_export_put()) final put ffff97c8ec6c1800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788309601.045129:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff97c8ec6c1800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788309601.047803:0:12959:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x63a04852f4628383 00000020:00000080:1.0:1788309601.047818:0:12959:0:(genops.c:885:class_export_put()) final put ffff97c8ed04a800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788309601.047883:0:12959:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1788309601.047890:0:12959:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788309601.047899:0:12959:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788309601.047903:0:12959:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff97c8e64499b8) has no exports 00000004:01000000:1.0:1788309601.048160:0:12959:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788309601.048182:0:12959:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x63a04852f46285c1 00000020:00000080:1.0:1788309601.048187:0:12959:0:(genops.c:885:class_export_put()) final put ffff97c8fc784800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788309601.051672:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff97c8ed04a800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788309601.054300:0:12959:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788309601.054327:0:12959:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788309601.054352:0:12959:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788309601.054358:0:12959:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff97c8ecf78000) has no exports 00000020:00000080:1.0:1788309601.054367:0:12959:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x63a04852f46285ba 00000020:00000080:1.0:1788309601.054377:0:12959:0:(genops.c:885:class_export_put()) final put ffff97c8ffc73000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788309601.058717:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff97c8fc784800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:1.0:1788309601.060180:0:12959:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788309601.060188:0:12959:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788309601.060193:0:12959:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:1.0:1788309601.060211:0:12959:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788309601.060214:0:12959:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788309601.063685:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff97c8ffc73000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788309601.063829:0:12959:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788309601.063847:0:12959:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788309601.063858:0:12959:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x63a04852f46284da 00000020:00000080:1.0:1788309601.063868:0:12959:0:(genops.c:885:class_export_put()) final put ffff97c8ec948000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788309601.063875:0:12959:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788309601.063882:0:12959:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788309601.063888:0:12959:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788309601.063892:0:12959:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff97c8eff499b8) has no exports 00000020:00000080:1.0:1788309601.063900:0:12959:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x63a04852f46284d3 00000020:00000080:1.0:1788309601.063904:0:12959:0:(genops.c:885:class_export_put()) final put ffff97c8e6952800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788309601.065164:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97c8f5556000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788309601.065177:0:38:0:(genops.c:885:class_export_put()) final put ffff97c8fc787800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788309601.065180:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff97c8fc787800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1788309601.065187:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788309601.065297:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff97c8ec948000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788309601.065305:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff97c8e6952800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788309601.068653:0:12959:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788309601.068663:0:12959:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788309601.068667:0:12959:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:0.0:1788309601.068678:0:12959:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788309601.068680:0:12959:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788309601.068750:0:12959:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788309601.068761:0:12959:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788309601.068792:0:12959:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788309601.068796:0:12959:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788309601.068803:0:12959:0:(genops.c:885:class_export_put()) final put ffff97c8ec6c0800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788309601.068808:0:12959:0:(genops.c:844:class_export_destroy()) destroying export ffff97c8ec6c0800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788309601.068815:0:12959:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788309601.069004:0:12959:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x63a04852f462838a 00000020:00000080:0.0:1788309601.069022:0:12959:0:(genops.c:885:class_export_put()) final put ffff97c8ed04c800/lustre-MDD0000_UUID 00000020:01000000:0.0:1788309601.069028:0:12959:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788309601.069032:0:12959:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788309601.069048:0:12959:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788309601.069052:0:12959:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff97c8e644b370) has no exports 00000020:00000080:0.0:1788309601.069072:0:12959:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788309601.069076:0:12959:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788309601.069081:0:12959:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x63a04852f4628391 00000020:00000080:0.0:1788309601.069086:0:12959:0:(genops.c:885:class_export_put()) final put ffff97c8ed04b800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788309601.069095:0:12959:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97c8e07b1000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788309601.069098:0:12959:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97c8e07b1000 3 00000020:01000004:0.0:1788309601.069101:0:12959:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff97c8e07b1000 from lustre-MDT0000 00000020:00000080:0.0:1788309601.069117:0:12959:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788309601.069120:0:12959:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788309601.069123:0:12959:0:(genops.c:885:class_export_put()) final put ffff97c8ec6c7800/lustre-MDT0000_UUID 00000020:00000080:0.0:1788309601.069125:0:12959:0:(genops.c:844:class_export_destroy()) destroying export ffff97c8ec6c7800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788309601.069132:0:12959:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1788309601.069158:0:12959:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1788309601.069161:0:12959:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788309601.069164:0:12959:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788309601.069167:0:12959:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788309601.069169:0:12959:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788309601.069176:0:12959:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff97c8e6655000 00707c3b-bc67-4313-a42d-1f5d185ea5d5 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788309601.069181:0:12959:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff97c8d6bd3370) has exports, disconnecting them 00000020:00080000:0.0:1788309601.069186:0:12959:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff97c8e6655000), last request at 1788309370 00000020:00000080:0.0:1788309601.069202:0:12959:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x63a04852f462832f 00000020:00010000:0.0:1788309601.069207:0:12959:0:(genops.c:1921:obd_stale_export_put()) Put export ffff97c8e6655000: total 2 00000100:00080000:0.0:1788309601.069210:0:12959:0:(import.c:65:import_set_state_nolock()) ffff97c8e6650800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788309601.069237:0:12959:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff97c8e6655000): rc 0 00000020:00080000:0.0:1788309601.069241:0:12959:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff97c8d6bd3370) has no exports 00000100:00100000:0.0:1788309601.069455:0:5830:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff97c8e066fe00:5830] 0 exiting: rc = 1 00000020:00010000:3.0:1788309601.069767:0:7627:0:(genops.c:1907:obd_stale_export_get()) Get export ffff97c8e6655000: total 2 00010000:00010000:3.0:1788309601.069805:0:7627:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff97c8e6655000, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1788309601.069853:0:7627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c8d73ee600/0x63a04852f462865b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x63a04852f4628654 expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309601.069873:0:7627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c8c153a600/0x63a04852f4628669 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x63a04852f4628662 expref: 8 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309601.069898:0:7627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c8f5549800/0x63a04852f4628876 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x63a04852f462886f expref: 7 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309601.069909:0:7627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c9021e4200/0x63a04852f4628884 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x63a04852f462887d expref: 6 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309601.069922:0:7627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c9021e5c00/0x63a04852f4628447 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x63a04852f4628440 expref: 5 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309601.069935:0:7627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c8c153b200/0x63a04852f4628693 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x63a04852f462868c expref: 4 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309601.069945:0:7627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c8d73ef600/0x63a04852f462863f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x63a04852f4628638 expref: 3 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309601.069956:0:7627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c8d73efa00/0x63a04852f462864d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x63a04852f4628646 expref: 2 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309601.069979:0:7627:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff97c8e6655000, canceled 8 locks, left on hash table 0. 00000020:00000080:3.0:1788309601.069993:0:7627:0:(genops.c:885:class_export_put()) final put ffff97c8e6655000/00707c3b-bc67-4313-a42d-1f5d185ea5d5 00010000:00010000:3.0:1788309601.069999:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309601.070001:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309601.070079:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788309601.070115:0:5831:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff97c8c3460c00:5831] 1 exiting: rc = 0 00000020:00000080:2.0:1788309601.070162:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97c8e6954800 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788309601.070173:0:38:0:(genops.c:885:class_export_put()) final put ffff97c8ffc71800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788309601.070175:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff97c8ffc71800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1788309601.070191:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788309601.070311:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff97c8ed04c800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1788309601.070334:0:38:0:(genops.c:885:class_export_put()) final put ffff97c8ec6c5800/lustre-MDD0000_UUID 00000020:00000080:2.0:1788309601.070336:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff97c8ec6c5800/lustre-MDD0000_UUID for lustre-MDD0000 00000100:00100000:3.0:1788309601.070343:0:5832:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff97c8e066fc00:5832] 2 exiting: rc = 0 00000020:01000000:2.0:1788309601.070343:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000100:00100000:3.0:1788309601.070430:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.070442:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.070453:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.070461:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.070473:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.070492:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.070500:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.070517:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.070527:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.070537:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.070548:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.070557:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788309601.070563:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff97c8ed04b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:3.0:1788309601.070570:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788309601.070574:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff97c8e6655000/00707c3b-bc67-4313-a42d-1f5d185ea5d5 for MGS 00000100:00100000:3.0:1788309601.070580:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.070588:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.070596:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.070605:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788309601.070614:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97c8e6650800 for MGS 00000100:00100000:3.0:1788309601.070615:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.070626:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.070633:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.070639:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.070645:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.070650:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.070656:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.070663:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.070670:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.070675:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.070681:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.070687:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.070692:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.070697:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.070703:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.070709:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.070715:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.070722:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.070728:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.070734:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.070741:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.070747:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.070754:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.070768:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.070774:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.070780:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.070786:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.070792:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.070797:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.070803:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.070808:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.070814:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.070819:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.070838:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.070845:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.070851:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.070856:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.070862:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.070867:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.070872:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.070877:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.070883:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.070888:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.070894:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.070899:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.070905:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.070910:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:3.0:1788309601.073651:0:12959:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788309601.073658:0:12959:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:2.0:1788309601.077875:0:12959:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff97c8f54d5180 - data ffff97c8faee5438/ffff97c8f52a3400 00000020:01000000:2.0:1788309601.079885:0:12959:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff97c8d9370540 - data ffff97c8e9799000/ffff97c8e6492400 00000020:00000080:2.0:1788309601.081540:0:12959:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x63a04852f4628313 00000020:00000080:2.0:1788309601.081549:0:12959:0:(genops.c:885:class_export_put()) final put ffff97c8e6b22800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788309601.081608:0:12959:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97c8e07b1000 from MGS, refs=2 00000020:01000004:2.0:1788309601.081613:0:12959:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97c8e07b1000 2 00000020:01000004:2.0:1788309601.081615:0:12959:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff97c8e07b1000 from MGS 00000020:00000080:2.0:1788309601.081637:0:12959:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788309601.081646:0:12959:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1788309601.081648:0:12959:0:(genops.c:885:class_export_put()) final put ffff97c8e6b26800/MGS 00000020:00000080:2.0:1788309601.081651:0:12959:0:(genops.c:844:class_export_destroy()) destroying export ffff97c8e6b26800/MGS for MGS 00000020:01000000:2.0:1788309601.081663:0:12959:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1788309601.081732:0:12959:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1788309601.081735:0:12959:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788309601.081741:0:12959:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788309601.081749:0:12959:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff97c8ec6c3800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788309601.081755:0:12959:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff97c8f4f34d28) has exports, disconnecting them 00000020:00080000:2.0:1788309601.081760:0:12959:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff97c8ec6c3800), last request at 1788309371 00000020:00000080:2.0:1788309601.081764:0:12959:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x63a04852f46283de 00000020:00080000:2.0:1788309601.081776:0:12959:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff97c8ec6c3800): rc 0 00000020:00000080:2.0:1788309601.081780:0:12959:0:(genops.c:885:class_export_put()) final put ffff97c8ec6c3800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788309601.083142:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff97c8e6b22800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788309601.090386:0:12959:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788309601.090420:0:12959:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788309601.090427:0:12959:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788309601.090441:0:12959:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788309601.090633:0:12959:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788309601.090642:0:12959:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788309601.090649:0:12959:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97c8e07b1000 1 00000020:00000080:0.0:1788309601.090658:0:12959:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x63a04852f4628305 00000020:00000080:0.0:1788309601.090668:0:12959:0:(genops.c:885:class_export_put()) final put ffff97c8e6b27000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1788309601.090673:0:12959:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788309601.090678:0:12959:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788309601.090682:0:12959:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788309601.090686:0:12959:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff97c8e644cd28) has no exports 00000020:00000080:1.0:1788309601.091886:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff97c8ec6c3800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788309601.091901:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97c8ec6c7000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788309601.091908:0:8:0:(genops.c:885:class_export_put()) final put ffff97c8ed048800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788309601.091910:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff97c8ed048800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1788309601.091914:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1788309601.091980:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff97c8e6b27000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788309601.155189:0:12959:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788309601.155216:0:12959:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1788309601.155222:0:12959:0:(genops.c:885:class_export_put()) final put ffff97c8e07b3800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788309601.155227:0:12959:0:(genops.c:844:class_export_destroy()) destroying export ffff97c8e07b3800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788309601.155239:0:12959:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1788309601.155434:0:12959:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff97c8e07b6000 00000020:01000000:1.0:1788309601.155459:0:12959:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1788309601.155462:0:12959:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788309601.155467:0:12959:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788309601.155472:0:12959:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff97c8e661cd28) has no exports 00000100:00100000:2.0:1788309601.155923:0:8305:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff97c8ffbda000:8305] 3 exiting: rc = 0 00000100:00100000:0.0:1788309601.157839:0:5837:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff97c8d93f3400:5837] 0 exiting: rc = 1 00000100:00100000:0.0:1788309601.157943:0:5838:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff97c8d93f2000:5838] 1 exiting: rc = 0 00000100:00100000:0.0:1788309601.158026:0:5839:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff97c8d93f3600:5839] 2 exiting: rc = 0 00000100:00100000:1.0:1788309601.160487:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.160498:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.160505:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.160512:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.160519:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.160526:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.160533:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.160540:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.160546:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.160552:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.160559:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.160565:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.160572:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.160578:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.160585:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.160591:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.160598:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.160606:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.160614:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.160624:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.160644:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.160649:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.160660:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.160665:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.160670:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.160687:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.160693:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.160698:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.160961:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.160977:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.160984:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.160994:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.161000:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.161005:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.161011:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.161016:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.161021:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.161026:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.161032:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.161038:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.161043:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.161049:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.161055:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.161067:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.161073:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.161079:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.161085:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.161090:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.161096:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.161102:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.161107:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.161112:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.161118:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.161124:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.161130:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.161136:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.161142:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.161149:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.161157:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.161164:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.161183:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.161191:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.161199:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.161208:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309601.170511:0:5840:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff97c8d93f2600:5840] 0 exiting: rc = 1 00000100:00100000:1.0:1788309601.171775:0:5841:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff97c8d93f3a00:5841] 1 exiting: rc = 0 00000100:00100000:0.0:1788309601.172196:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.172204:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.172210:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.172216:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.172223:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.172228:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.172234:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.172239:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.172245:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.172251:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.172257:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.172263:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.172270:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.172274:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.172301:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.172307:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.172312:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.172317:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.172336:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.172342:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.172347:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.172353:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.172359:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.172363:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.172369:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.172374:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.172381:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.172387:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.172392:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.172398:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.172403:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.172408:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.172413:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.172418:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.172423:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.172428:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.172433:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.172438:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.172444:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.172449:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.172454:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.172460:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.172466:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.172471:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.172476:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.172481:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.172486:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.172491:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.172496:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.172501:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.172506:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.172511:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.172517:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.172529:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.172534:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.172539:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.172544:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.172549:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.172555:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.172560:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.172567:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.172572:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.172577:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.172582:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.173726:0:5842:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff97c8c7763000:5842] 0 exiting: rc = 1 00000100:00100000:2.0:1788309601.173829:0:5843:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff97c8c7762200:5843] 1 exiting: rc = 0 00000100:00100000:1.0:1788309601.174398:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.174406:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.174412:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.174418:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.174424:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.174430:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.174436:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.174442:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.174447:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.174465:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.174472:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.174477:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.174484:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.174489:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.174494:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.174500:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.174505:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.174512:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.174526:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.174532:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.174537:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.174560:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.174566:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.174571:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.174576:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.174582:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.174588:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.174592:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.174598:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.174612:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.174618:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.174623:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.174628:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.174645:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.174652:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.174671:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.174677:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.174683:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.174689:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.174694:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.174699:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.174704:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.174711:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.174716:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.174722:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.174743:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.174751:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.174757:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.174762:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.174768:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.174775:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.174782:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.174789:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.174794:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.174801:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.174806:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.174813:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.174836:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.174844:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.174850:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.174855:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.174861:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.174867:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.174872:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309601.199508:0:5844:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff97c8e66aec00:5844] 0 exiting: rc = 1 00000100:00100000:3.0:1788309601.199510:0:5845:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff97c8e66afc00:5845] 1 exiting: rc = 0 00000100:00100000:0.0:1788309601.199667:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.199679:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.199685:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.199689:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.199694:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.199698:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.199703:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.199708:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.199713:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.199718:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.199723:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.199728:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.199732:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.199737:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.199742:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.199746:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.199750:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.199755:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.199760:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.199765:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.199770:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.199775:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.199780:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.199785:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.199805:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.199810:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.199815:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.199820:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.199824:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.199829:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.199834:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.199838:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.199844:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.199849:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.199854:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.199860:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.199864:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.199869:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.199874:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.199879:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.199884:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.199889:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.199894:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.199899:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.199903:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.199907:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.199912:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.199917:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.199922:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.199927:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.199931:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.199936:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.199941:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.199946:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.199951:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.199955:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.199960:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.199977:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.199983:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.199995:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.199999:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.200005:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.200010:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.200016:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.200343:0:5847:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff97c8c55fbe00:5847] 1 exiting: rc = 0 00000100:00100000:1.0:1788309601.200407:0:5846:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff97c8e66af800:5846] 0 exiting: rc = 1 00000100:00100000:0.0:1788309601.200617:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.200623:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.200629:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.200634:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.200639:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.200645:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.200649:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.200654:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.200658:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.200664:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.200669:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.200673:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.200678:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.200683:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.200687:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.200692:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.200696:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.200701:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.200705:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.200710:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.200715:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.200720:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.200725:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.200730:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.200735:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.200740:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.200744:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.200749:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.200753:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.200766:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.200771:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.200775:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.200780:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.200784:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.200789:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.200794:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.200799:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.200804:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.200809:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.200813:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.200818:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.200823:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.200828:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.200832:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.200838:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.200843:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.200848:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.200854:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.200858:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.200864:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.200869:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.200874:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.200878:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.200883:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.200887:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.200892:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.200897:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.200902:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.200907:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.200913:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.200917:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.200922:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.200926:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.200930:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.202115:0:5849:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff97c8c55fa000:5849] 1 exiting: rc = 0 00000100:00100000:1.0:1788309601.203298:0:5848:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff97c8c55fa200:5848] 0 exiting: rc = 1 00000100:00100000:0.0:1788309601.204577:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.204586:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.204592:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.204597:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.204602:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.204608:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.204613:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.204618:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.204622:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.204629:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.204635:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.204640:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.204644:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.204650:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.204655:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.204660:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.204666:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.204670:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.204675:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.204681:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.204686:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.204691:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.204695:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.204700:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.204705:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.204710:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.204715:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.204721:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.204725:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.204730:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.204734:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.204738:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.204743:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.204747:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.204752:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.204773:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.204780:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.204785:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.204789:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.204801:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.204806:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.204812:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.204816:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.204821:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.204826:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.204830:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.204835:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.204840:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.204846:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.204851:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.204856:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.204861:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.204865:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.204870:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.204875:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.204880:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.204885:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.204890:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.204894:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.204899:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.204904:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.204909:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.204914:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.204919:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309601.205877:0:5850:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff97c8e6497200:5850] 0 exiting: rc = 1 00000100:00100000:0.0:1788309601.206413:0:5851:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff97c8e6496c00:5851] 1 exiting: rc = 0 00000100:00100000:0.0:1788309601.206845:0:5852:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff97c8e06d6400:5852] 2 exiting: rc = 0 00000100:00100000:3.0:1788309601.209401:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.209413:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.209419:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.209424:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.209447:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.209452:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.209456:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.209469:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.209473:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.209477:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.209480:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.209484:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.209488:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.209493:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.209497:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.209500:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.209506:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.209513:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.209519:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.209524:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.209536:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.209542:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.209551:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.209557:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.209565:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.209571:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.209578:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.209588:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.209612:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.209622:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.209627:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.209632:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.209637:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.209642:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.209647:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.209652:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.209658:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.209663:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.209668:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.209674:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.209680:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.209685:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.209699:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.209704:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.209710:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.209715:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.209720:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.209726:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.209731:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.209736:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.209741:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.209747:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.209766:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.209773:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.209778:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.209783:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.209789:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.209793:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.209799:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.209818:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.209823:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.209828:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.209833:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309601.209839:0:12959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788309601.214709:0:12959:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788309601.214726:0:12959:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1788309601.214733:0:12959:0:(genops.c:885:class_export_put()) final put ffff97c8c979c000/MDS_uuid 00000020:00000080:3.0:1788309601.214739:0:12959:0:(genops.c:844:class_export_destroy()) destroying export ffff97c8c979c000/MDS_uuid for MDS 00000020:01000000:3.0:1788309601.214746:0:12959:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1788309601.214887:0:12959:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1788309602.016407:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309603.045605:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309604.067441:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788309604.329100:0:13114:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1788309604.356007:0:13114:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1788309604.356055:0:13114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8c153ba00/0x63a04852f4628654 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f462865b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309604.356071:0:13114:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8c153ba00/0x63a04852f4628654 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x63a04852f462865b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309604.356098:0:13114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8c153ba00/0x63a04852f4628654 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x63a04852f462865b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309604.356105:0:13114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.155@tcp lock: ffff97c8c153ba00/0x63a04852f4628654 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x63a04852f462865b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309604.356134:0:13114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788309604.356139:0:13114:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788309604.356160:0:13114:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788309604.356164:0:13114:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788309604.356169:0:13114:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788309604.356174:0:13114:0:(import.c:65:import_set_state_nolock()) ffff97c8d123d800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1788309604.356178:0:13114:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788309604.356179:0:13114:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788309604.356181:0:13114:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788309604.357779:0:7627:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788309604.357792:0:7627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff97c8c153ba00/0x63a04852f4628654 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x63a04852f462865b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309604.357818:0:7627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8c153ba00 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:0.0:1788309604.357823:0:7627:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff97c8c153ba00/0x63a04852f4628654 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x63a04852f462865b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309604.357833:0:7627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff97c8c153ba00/0x63a04852f4628654 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x63a04852f462865b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788309604.357840:0:7627:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff97c8c153ba00/0x63a04852f4628654 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x63a04852f462865b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788309604.357846:0:7627:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788309604.357849:0:7627:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788309604.357853:0:7627:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788309604.357894:0:7627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff97c8c153ba00/0x63a04852f4628654 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x63a04852f462865b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309604.357900:0:7627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788309604.357926:0:7627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff97c8c153ba00/0x63a04852f4628654 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x63a04852f462865b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309604.357932:0:7627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff97c8c153ba00/0x63a04852f4628654 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x63a04852f462865b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309604.357957:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309604.357959:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309604.357961:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788309604.357979:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffbb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3301:1875178210545280:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788309604.358047:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309604.358125:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210545280 00000100:00100000:0.0:1788309604.358137:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210545280 00000100:00100000:0.0:1788309604.358180:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788309604.358187:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffbb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3301:x1875178210545280:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788309604.358194:0:5822:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788309604 with bad export cookie 7178817327153185583 00010000:00010000:1.0:1788309604.362818:0:13114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8d73efc00/0x63a04852f4628662 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4628669 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309604.362838:0:13114:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8d73efc00/0x63a04852f4628662 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x63a04852f4628669 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309604.362847:0:13114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8d73efc00/0x63a04852f4628662 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x63a04852f4628669 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309604.362855:0:13114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.155@tcp lock: ffff97c8d73efc00/0x63a04852f4628662 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x63a04852f4628669 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309604.362886:0:13114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788309604.362895:0:13114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c9021e4c00/0x63a04852f462887d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4628884 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309604.362902:0:13114:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c9021e4c00/0x63a04852f462887d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x63a04852f4628884 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309604.362908:0:13114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c9021e4c00/0x63a04852f462887d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x63a04852f4628884 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309604.362915:0:13114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.155@tcp lock: ffff97c9021e4c00/0x63a04852f462887d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x63a04852f4628884 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309604.362945:0:13114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1788309604.362950:0:13114:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1788309604.362998:0:13114:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1788309604.363002:0:13114:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1788309604.363007:0:13114:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788309604.363012:0:13114:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788309604.363017:0:13114:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff97c8e6618000) has no exports 00000020:00080000:1.0:1788309604.363049:0:13114:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff97c8e6618000) has no exports 00010000:00010000:2.0:1788309604.363713:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788309604.363723:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff97c8d73efc00/0x63a04852f4628662 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x63a04852f4628669 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309604.363731:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8d73efc00 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:2.0:1788309604.363735:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff97c8d73efc00/0x63a04852f4628662 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x63a04852f4628669 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309604.363744:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff97c8d73efc00/0x63a04852f4628662 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x63a04852f4628669 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788309604.363751:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff97c8d73efc00/0x63a04852f4628662 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x63a04852f4628669 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788309604.363756:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788309604.363759:0:5825:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1788309604.363761:0:5825:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1788309604.363804:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff97c8d73efc00/0x63a04852f4628662 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x63a04852f4628669 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309604.363810:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788309604.363845:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff97c8d73efc00/0x63a04852f4628662 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x63a04852f4628669 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309604.363852:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff97c8d73efc00/0x63a04852f4628662 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x63a04852f4628669 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309604.363869:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788309604.363881:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff97c9021e4c00/0x63a04852f462887d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x63a04852f4628884 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309604.363887:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c9021e4c00 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:2.0:1788309604.363890:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff97c9021e4c00/0x63a04852f462887d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x63a04852f4628884 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309604.363897:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff97c9021e4c00/0x63a04852f462887d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x63a04852f4628884 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788309604.363903:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff97c9021e4c00/0x63a04852f462887d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x63a04852f4628884 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788309604.363908:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788309604.363910:0:5825:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788309604.363912:0:5825:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788309604.363927:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff97c9021e4c00/0x63a04852f462887d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x63a04852f4628884 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309604.363943:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788309604.363950:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff97c9021e4c00/0x63a04852f462887d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x63a04852f4628884 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309604.363957:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff97c9021e4c00/0x63a04852f462887d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x63a04852f4628884 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309604.363968:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309604.363970:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309604.363972:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788309604.363993:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3302:1875178210545408:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788309604.364065:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309604.364131:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788309604.364138:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3302:1875178210545536:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788309604.364160:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309604.364189:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210545408 00000100:00100000:2.0:1788309604.364196:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210545408 00000100:00100000:2.0:1788309604.364221:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210545536 00000100:00100000:2.0:1788309604.364223:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210545536 00000100:00100000:2.0:1788309604.364235:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788309604.364243:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8eff0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3302:x1875178210545408:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788309604.364249:0:8447:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788309604 with bad export cookie 7178817327153185583 00000100:00100000:2.0:1788309604.364316:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8eff0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3302:x1875178210545408:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (250us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788309604.364323:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788309604.364339:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788309604.364344:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8eff0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3302:x1875178210545536:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788309604.364348:0:8447:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788309604 with bad export cookie 7178817327153185583 00000100:00100000:2.0:1788309604.364371:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8eff0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3302:x1875178210545536:12345-0@lo:103:ldlm_bl.0 Request processed in 26us (210us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788309604.364377:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1788309604.364411:0:3302:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.155@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788309604.364415:0:3302:0:(import.c:65:import_set_state_nolock()) ffff97c8c979d000 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1788309604.364419:0:3302:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.155@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:3.0:1788309604.365692:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788309604.367980:0:13114:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff97c8f54d5e40 - data ffff97c8fae68798/ffff97c8d6a3a000 00000020:01000000:1.0:1788309604.368150:0:13114:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff97c8ffd57cc0 - data ffff97c8fae05288/ffff97c8ffc80800 00000100:00100000:0.0:1788309604.369239:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffbb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3301:x1875178210545280:12345-0@lo:103:ldlm_bl.0 Request processed in 11045us (11186us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788309604.369252:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1788309604.369330:0:3301:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.155@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788309604.393409:0:3302:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.155@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1788309604.393416:0:3302:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788309604.393427:0:3302:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff97c8ffbb1880 x1875178210545280/t0(0) o103->MGC192.168.202.155@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788309620 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788309604.393444:0:3302:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff97c8eff0fb80 x1875178210545408/t0(0) o103->MGC192.168.202.155@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788309620 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788309604.393473:0:3302:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff97c8eff0d500 x1875178210545536/t0(0) o103->MGC192.168.202.155@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788309620 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788309604.394070:0:3302:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788309604.394075:0:3302:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788309604.394076:0:3302:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788309604.398605:0:3301:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff97c8c979d000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:0.0:1788309604.398643:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffbb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3301:1875178210545280:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1788309604.399107:0:3302:0:(import.c:65:import_set_state_nolock()) ffff97c8c979d000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788309604.399115:0:3302:0:(import.c:510:import_select_connection()) MGC192.168.202.155@tcp: connect to NID 0@lo last attempt 133 00000100:00080000:2.0:1788309604.399123:0:3302:0:(import.c:624:import_select_connection()) MGC192.168.202.155@tcp: import ffff97c8c979d000 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:2.0:1788309604.399159:0:3302:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97c8eff0d180 x1875178210545664/t0(0) o250->MGC192.168.202.155@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788309604.399204:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3302:1875178210545408:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788309604.399223:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3302:1875178210545536:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788309604.399380:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3299:1875178210545664:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:0.0:1788309604.399912:0:3299:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875178210545664 offset 0 length 520: 4 00100000:10000000:0.0:1788309604.429076:0:13114:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788309604.468444:0:13114:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x63a04852f4628463 00000020:00000080:2.0:1788309604.468455:0:13114:0:(genops.c:885:class_export_put()) final put ffff97c8efc6b000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1788309604.468481:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff97c8efc6b000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000004:0.0:1788309604.468841:0:13114:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97c8d6805000 from lustre-OST0000, refs=2 00000020:01000004:0.0:1788309604.468846:0:13114:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97c8d6805000 2 00000020:01000004:0.0:1788309604.468848:0:13114:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff97c8d6805000 from lustre-OST0000 00000020:00000080:0.0:1788309604.468880:0:13114:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788309604.468889:0:13114:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1788309604.468893:0:13114:0:(genops.c:885:class_export_put()) final put ffff97c8ee5cb000/lustre-OST0000_UUID 00000020:00000080:0.0:1788309604.468895:0:13114:0:(genops.c:844:class_export_destroy()) destroying export ffff97c8ee5cb000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1788309604.468903:0:13114:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1788309604.469066:0:13114:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1788309604.469070:0:13114:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788309604.469074:0:13114:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788309604.469079:0:13114:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788309604.469086:0:13114:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff97c8ffc72800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788309604.469092:0:13114:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff97c8eff4cd28) has exports, disconnecting them 00000020:00080000:0.0:1788309604.469130:0:13114:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff97c8ffc72800), last request at 1788309390 00000020:00000080:0.0:1788309604.469134:0:13114:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x63a04852f462848d 00000020:00080000:0.0:1788309604.469150:0:13114:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff97c8ffc72800): rc 0 00000020:00000080:0.0:1788309604.469155:0:13114:0:(genops.c:885:class_export_put()) final put ffff97c8ffc72800/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788309604.469209:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff97c8ffc72800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1788309604.479614:0:13114:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1788309604.479696:0:13114:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788309604.479700:0:13114:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788309604.479709:0:13114:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788309604.479911:0:13114:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788309604.479921:0:13114:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:1.0:1788309604.479929:0:13114:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97c8d6805000 1 00000020:00000080:1.0:1788309604.480052:0:13114:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x63a04852f462841d 00000020:00000080:1.0:1788309604.480062:0:13114:0:(genops.c:885:class_export_put()) final put ffff97c8d6800000/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1788309604.480068:0:13114:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1788309604.480074:0:13114:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788309604.480079:0:13114:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788309604.480083:0:13114:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff97c8e66199b8) has no exports 00000020:00000080:3.0:1788309604.480165:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97c8d123d800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788309604.480172:0:38:0:(genops.c:885:class_export_put()) final put ffff97c8d1239800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1788309604.480175:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff97c8d1239800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1788309604.480181:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1788309604.480236:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff97c8d6800000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788309604.507451:0:13114:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788309604.507464:0:13114:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1788309604.507469:0:13114:0:(genops.c:885:class_export_put()) final put ffff97c8d14c4000/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1788309604.507473:0:13114:0:(genops.c:844:class_export_destroy()) destroying export ffff97c8d14c4000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1788309604.507485:0:13114:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1788309604.507712:0:13114:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff97c8d14c3000 00000020:02000400:2.0:1788309604.507808:0:13114:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00000100:00080000:0.0:1788309604.842394:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788309604.842404:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788309604.842408:0:38:0:(import.c:65:import_set_state_nolock()) ffff97c8fc782800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788309604.842417:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 362 00000100:00080000:0.0:1788309604.842423:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788309604.842429:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff97c8fc782800 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:0.0:1788309604.842468:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97c8ffbb1880 x1875178210545792/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788309604.842599:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffbb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3299:1875178210545792:0@lo:38:kworker.0 00000400:00000100:3.0:1788309604.842649:0:3299:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875178210545792 offset 0 length 520: 4 00010000:00010000:2.0:1788309605.093785:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309606.114832:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309607.136377:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788309607.450159:0:13265:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1788309607.472926:0:13265:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1788309607.473010:0:13265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8c153a400/0x63a04852f4628638 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f462863f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309607.473026:0:13265:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8c153a400/0x63a04852f4628638 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x63a04852f462863f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309607.473033:0:13265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8c153a400/0x63a04852f4628638 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x63a04852f462863f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309607.473040:0:13265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.155@tcp lock: ffff97c8c153a400/0x63a04852f4628638 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x63a04852f462863f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309607.473120:0:13265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788309607.473127:0:13265:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788309607.473152:0:13265:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788309607.473164:0:13265:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff97c8ffbb1880 x1875178210545792/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788309619 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788309607.473184:0:13265:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788309607.473192:0:13265:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788309607.473198:0:13265:0:(import.c:65:import_set_state_nolock()) ffff97c8fc782800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788309607.473203:0:13265:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788309607.473207:0:13265:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff97c8ffbb1880 x1875178210545792/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788309619 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788309607.473214:0:13265:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788309607.473217:0:13265:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00000100:00100000:0.0:1788309607.473324:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffbb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3299:1875178210545792:0@lo:38:kworker.0 00010000:00010000:3.0:1788309607.474844:0:13265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8c153b800/0x63a04852f4628646 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f462864d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309607.474863:0:13265:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8c153b800/0x63a04852f4628646 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x63a04852f462864d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309607.474887:0:13265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8c153b800/0x63a04852f4628646 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x63a04852f462864d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309607.474895:0:13265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.155@tcp lock: ffff97c8c153b800/0x63a04852f4628646 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x63a04852f462864d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309607.475036:0:7628:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788309607.475045:0:7628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff97c8c153a400/0x63a04852f4628638 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x63a04852f462863f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309607.475053:0:7628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8c153a400 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:2.0:1788309607.475064:0:7628:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff97c8c153a400/0x63a04852f4628638 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x63a04852f462863f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309607.475073:0:7628:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff97c8c153a400/0x63a04852f4628638 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x63a04852f462863f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788309607.475080:0:7628:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff97c8c153a400/0x63a04852f4628638 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x63a04852f462863f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788309607.475085:0:7628:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788309607.475087:0:7628:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788309607.475090:0:7628:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788309607.475103:0:7628:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff97c8c979d000 00010000:00010000:2.0:1788309607.475107:0:7628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff97c8c153a400/0x63a04852f4628638 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x63a04852f462863f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309607.475113:0:7628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff97c8c153a400/0x63a04852f4628638 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x63a04852f462863f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309607.475458:0:7628:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788309607.475463:0:7628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff97c8c153b800/0x63a04852f4628646 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x63a04852f462864d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309607.475480:0:7628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8c153b800 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:2.0:1788309607.475483:0:7628:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff97c8c153b800/0x63a04852f4628646 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x63a04852f462864d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309607.475492:0:7628:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff97c8c153b800/0x63a04852f4628646 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x63a04852f462864d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788309607.475499:0:7628:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff97c8c153b800/0x63a04852f4628646 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x63a04852f462864d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788309607.475511:0:7628:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788309607.475514:0:7628:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:2.0:1788309607.475520:0:7628:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff97c8c979d000 00010000:00010000:2.0:1788309607.475523:0:7628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff97c8c153b800/0x63a04852f4628646 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x63a04852f462864d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309607.475531:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309607.475533:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309607.475535:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309607.475795:0:13265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788309607.475802:0:13265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff97c8c153b800/0x63a04852f4628646 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x63a04852f462864d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309607.475819:0:13265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c9021e5600/0x63a04852f462886f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4628876 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309607.475826:0:13265:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c9021e5600/0x63a04852f462886f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x63a04852f4628876 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309607.475833:0:13265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c9021e5600/0x63a04852f462886f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x63a04852f4628876 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309607.475840:0:13265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.155@tcp lock: ffff97c9021e5600/0x63a04852f462886f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x63a04852f4628876 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309607.475886:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788309607.475891:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff97c9021e5600/0x63a04852f462886f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x63a04852f4628876 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309607.475898:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c9021e5600 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:2.0:1788309607.475901:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff97c9021e5600/0x63a04852f462886f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x63a04852f4628876 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309607.475921:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff97c9021e5600/0x63a04852f462886f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x63a04852f4628876 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788309607.475927:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff97c9021e5600/0x63a04852f462886f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x63a04852f4628876 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788309607.475932:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788309607.475934:0:5824:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1788309607.475940:0:5824:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff97c8c979d000 00010000:00010000:2.0:1788309607.475943:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff97c9021e5600/0x63a04852f462886f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x63a04852f4628876 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309607.475959:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309607.475961:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309607.475963:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309607.476089:0:13265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788309607.476094:0:13265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff97c9021e5600/0x63a04852f462886f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x63a04852f4628876 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788309607.476111:0:13265:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:3.0:1788309607.476116:0:13265:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:3.0:1788309607.476118:0:13265:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1788309607.476157:0:13265:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1788309607.476161:0:13265:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1788309607.476167:0:13265:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788309607.476172:0:13265:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788309607.476177:0:13265:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff97c8eff4b370) has no exports 00000020:00080000:3.0:1788309607.476201:0:13265:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff97c8eff4b370) has no exports 00010000:00010000:0.0:1788309607.477601:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788309607.479767:0:13265:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff97c8f54d52a0 - data ffff97c8e9591948/ffff97c8d6a39c00 00000020:01000000:0.0:1788309607.479943:0:13265:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff97c7c353b0c0 - data ffff97c7c19b1ca8/ffff97c8f5565400 00100000:10000000:0.0:1788309607.493796:0:13265:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788309607.519849:0:13265:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x63a04852f462852e 00000020:00000080:2.0:1788309607.519861:0:13265:0:(genops.c:885:class_export_put()) final put ffff97c8f5553800/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1788309607.519976:0:13265:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97c8f519c800 from lustre-OST0001, refs=2 00000020:01000004:2.0:1788309607.519981:0:13265:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97c8f519c800 2 00000020:01000004:2.0:1788309607.519985:0:13265:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff97c8f519c800 from lustre-OST0001 00000020:00000080:2.0:1788309607.520012:0:13265:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788309607.520026:0:13265:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1788309607.520030:0:13265:0:(genops.c:885:class_export_put()) final put ffff97c8f5556800/lustre-OST0001_UUID 00000020:00000080:2.0:1788309607.520034:0:13265:0:(genops.c:844:class_export_destroy()) destroying export ffff97c8f5556800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1788309607.520040:0:13265:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1788309607.520157:0:13265:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 00707c3b-bc67-4313-a42d-1f5d185ea5d5->MGS 00010000:00010000:2.0:1788309607.520174:0:13265:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff97c8c153b400/0x63a04852f4628440 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x63a04852f4628447 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788309607.520186:0:13265:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff97c8c153b400/0x63a04852f4628440 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x63a04852f4628447 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788309607.520194:0:13265:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1788309607.520197:0:13265:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1788309607.520201:0:13265:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1788309607.520215:0:13265:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff97c8c979d000 00010000:00010000:2.0:1788309607.520218:0:13265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff97c8c153b400/0x63a04852f4628440 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x63a04852f4628447 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309607.520233:0:13265:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff97c8d73ee800/0x63a04852f462868c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x63a04852f4628693 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788309607.520255:0:13265:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff97c8d73ee800/0x63a04852f462868c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x63a04852f4628693 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788309607.520385:0:13265:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788309607.520388:0:13265:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1788309607.520389:0:13265:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1788309607.520402:0:13265:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff97c8c979d000 00010000:00010000:2.0:1788309607.520404:0:13265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff97c8d73ee800/0x63a04852f462868c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x63a04852f4628693 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788309607.520423:0:13265:0:(import.c:65:import_set_state_nolock()) ffff97c8c979d000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1788309607.520428:0:13265:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788309607.520431:0:13265:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788309607.520432:0:13265:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788309607.520436:0:13265:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788309607.520448:0:13265:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff97c8eff0d180 x1875178210545664/t0(0) o250->MGC192.168.202.155@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788309614 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788309607.520573:0:13265:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788309607.520577:0:13265:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:3.0:1788309607.520799:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:00707c3b-bc67-4313-a42d-1f5d185ea5d5:3299:1875178210545664:0@lo:250:ptlrpcd_00_02.0 10000000:01000000:2.0:1788309607.520856:0:13265:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788309607.520864:0:13265:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x63a04852f4628321 00000020:00000080:2.0:1788309607.520870:0:13265:0:(genops.c:885:class_export_put()) final put ffff97c8c979f000/00707c3b-bc67-4313-a42d-1f5d185ea5d5 00000020:00000080:1.0:1788309607.520937:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff97c8f5553800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1788309607.521149:0:13265:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.155@tcp (flags='') 00000020:00000080:2.0:1788309607.521155:0:13265:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788309607.521163:0:13265:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.155@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788309607.521168:0:13265:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff97c8e661b370) has no exports 10000000:01000000:3.0:1788309607.521228:0:5834:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 00000020:00000080:1.0:1788309607.521404:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff97c8c979f000/00707c3b-bc67-4313-a42d-1f5d185ea5d5 for MGC192.168.202.155@tcp 10000000:01000000:2.0:1788309607.521463:0:13265:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.202.155@tcp: client import never connected 00000100:00080000:2.0:1788309607.521467:0:13265:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1788309607.521469:0:13265:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788309607.521677:0:13265:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1788309607.521690:0:13265:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788309607.521738:0:13265:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788309607.521744:0:13265:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.155@tcp (uuid 00707c3b-bc67-4313-a42d-1f5d185ea5d5) 00000020:01000000:2.0:1788309607.521749:0:13265:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788309607.521753:0:13265:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788309607.521757:0:13265:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788309607.521762:0:13265:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff97c8fc786000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788309607.521767:0:13265:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff97c8ecf799b8) has exports, disconnecting them 00000020:00080000:2.0:1788309607.521771:0:13265:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff97c8fc786000), last request at 1788309411 00000020:00000080:2.0:1788309607.521776:0:13265:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x63a04852f4628558 00000020:00080000:2.0:1788309607.521790:0:13265:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff97c8fc786000): rc 0 00000020:00000080:2.0:1788309607.521794:0:13265:0:(genops.c:885:class_export_put()) final put ffff97c8fc786000/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788309607.522093:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97c8c979d000 for MGC192.168.202.155@tcp 00000020:00000080:1.0:1788309607.522099:0:8:0:(genops.c:885:class_export_put()) final put ffff97c8c9798000/00707c3b-bc67-4313-a42d-1f5d185ea5d5 00000020:00000080:1.0:1788309607.522102:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff97c8c9798000/00707c3b-bc67-4313-a42d-1f5d185ea5d5 for MGC192.168.202.155@tcp 00000020:01000000:1.0:1788309607.522107:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.155@tcp (00707c3b-bc67-4313-a42d-1f5d185ea5d5) 00000020:00000080:1.0:1788309607.524273:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff97c8fc786000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1788309607.524411:0:13265:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1788309607.524416:0:13265:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788309607.524421:0:13265:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788309607.524427:0:13265:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788309607.524839:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97c8fc782800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:3.0:1788309607.526738:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1788309607.534395:0:7628:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1788309607.536399:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:3.0:1788309607.536721:0:7627:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:3.0:1788309607.536894:0:5819:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff97c8d16d0a00:5819] 0 exiting: rc = 1 00000100:00100000:1.0:1788309607.538416:0:5820:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff97c8c307b000:5820] 1 exiting: rc = 0 00000100:00100000:3.0:1788309607.538649:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.538876:0:5822:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff97c8e0528200:5822] 1 exiting: rc = 0 00000100:00100000:1.0:1788309607.540623:0:5823:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff97c8ea291200:5823] 2 exiting: rc = 0 00000100:00100000:3.0:1788309607.542647:0:8447:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff97c8e68afe00:8447] 3 exiting: rc = 0 00000100:00100000:3.0:1788309607.544998:0:5821:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff97c8e0528e00:5821] 0 exiting: rc = 1 00000100:00100000:1.0:1788309607.546812:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309607.546825:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309607.546832:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309607.546838:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309607.546844:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309607.546851:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309607.546857:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309607.546862:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309607.546867:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309607.546872:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309607.546878:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309607.546883:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309607.546889:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309607.546896:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309607.546903:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309607.546921:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309607.546928:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309607.546933:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309607.546938:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309607.546943:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309607.546947:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309607.546952:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309607.546957:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309607.546962:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309607.546967:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309607.546972:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309607.546978:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309607.546983:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309607.546988:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309607.546994:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309607.546999:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309607.547004:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309607.547010:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309607.547015:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309607.547042:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309607.547047:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309607.547052:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309607.547056:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309607.547061:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309607.547067:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309607.547071:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309607.547076:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309607.547080:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309607.547085:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309607.547090:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309607.547095:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309607.547100:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309607.547105:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309607.547110:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309607.547115:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309607.547120:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309607.547126:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309607.547131:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309607.547137:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309607.547142:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309607.547147:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309607.547151:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309607.547157:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309607.547161:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309607.547165:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309607.547171:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309607.547175:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309607.547179:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309607.547184:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788309607.549040:0:13265:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788309607.549053:0:13265:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1788309607.549059:0:13265:0:(genops.c:885:class_export_put()) final put ffff97c8f5550000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1788309607.549064:0:13265:0:(genops.c:844:class_export_destroy()) destroying export ffff97c8f5550000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1788309607.549073:0:13265:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:3.0:1788309607.549127:0:13265:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97c8f519c800 1 00000020:00000080:3.0:1788309607.549134:0:13265:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x63a04852f46284fd 00000020:00000080:3.0:1788309607.549142:0:13265:0:(genops.c:885:class_export_put()) final put ffff97c8f5502800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1788309607.549159:0:13265:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1788309607.549172:0:13265:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788309607.549176:0:13265:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788309607.549180:0:13265:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff97c8eff48000) has no exports 00000020:00000080:1.0:1788309607.549380:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff97c8f5502800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1788309607.564018:0:13265:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788309607.564037:0:13265:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1788309607.564042:0:13265:0:(genops.c:885:class_export_put()) final put ffff97c8f519e000/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1788309607.564047:0:13265:0:(genops.c:844:class_export_destroy()) destroying export ffff97c8f519e000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1788309607.564054:0:13265:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1788309607.564299:0:13265:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff97c8f5199000 00000020:01000000:3.0:1788309607.564320:0:13265:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1788309607.564324:0:13265:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788309607.564327:0:13265:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788309607.564331:0:13265:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff97c8d6bd19b8) has no exports 00000020:00000080:3.0:1788309607.564352:0:13265:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788309607.564358:0:13265:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1788309607.564361:0:13265:0:(genops.c:885:class_export_put()) final put ffff97c8d6802800/OSS_uuid 00000020:00000080:3.0:1788309607.564364:0:13265:0:(genops.c:844:class_export_destroy()) destroying export ffff97c8d6802800/OSS_uuid for OSS 00000020:01000000:3.0:1788309607.564367:0:13265:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1788309607.565568:0:6682:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff97c8e6b2d800:6682] 2 exiting: rc = 0 00000100:00100000:2.0:1788309607.565675:0:6680:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff97c8fc3c5a00:6680] 0 exiting: rc = 1 00000100:00100000:2.0:1788309607.565721:0:12478:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff97c8ffbda800:12478] 4 exiting: rc = 0 00000100:00100000:2.0:1788309607.565784:0:10673:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff97c8d6b78c00:10673] 3 exiting: rc = 0 00000100:00080000:1.0:1788309607.574803:0:5833:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1788309607.576445:0:6681:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff97c8c62f4a00:6681] 1 exiting: rc = 0 00000100:00100000:3.0:1788309607.576722:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.576732:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.576738:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.576743:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.576748:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.576753:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.576758:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.576763:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.576768:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.576773:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.576777:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.576782:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.576787:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.576792:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.576796:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.576800:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.576819:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.576824:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.576829:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.576834:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.576840:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.576845:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.576850:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.576855:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.576859:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.576864:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.576869:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.576874:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.576879:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.576885:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.576889:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.576894:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.576899:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.576915:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.576921:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.576926:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.576931:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.576936:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.576942:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.576947:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.576952:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.576958:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.576964:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.576969:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.576974:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.576981:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.576986:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.576990:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.576996:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.577001:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.577007:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.577020:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.577028:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.577033:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.577038:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.577044:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.577050:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.577056:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.577060:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.577065:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.577069:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.577074:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.577079:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.577083:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.577965:0:6683:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff97c8c62f4000:6683] 0 exiting: rc = 1 00000100:00100000:1.0:1788309607.578533:0:6685:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff97c8c62f4400:6685] 1 exiting: rc = 0 00000100:00100000:3.0:1788309607.578744:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.578752:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.578757:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.578762:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.578767:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.578772:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.578777:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.578783:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.578787:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.578792:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.578796:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.578802:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.578806:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.578812:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.578816:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.578821:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.578825:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.578830:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.578835:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.578841:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.578846:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.578865:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.578870:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.578875:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.578881:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.578886:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.578891:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.578897:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.578902:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.578916:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.578922:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.578927:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.578932:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.578937:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.578943:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.578949:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.578954:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.578959:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.578963:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.578969:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.578974:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.578979:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.578985:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.578991:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.578995:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.579000:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.579005:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.579010:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.579014:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.579019:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.579024:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.579029:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.579033:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.579038:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.579042:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.579048:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.579061:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.579066:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.579071:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.579076:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.579081:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.579086:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.579090:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.579095:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.580178:0:6687:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff97c8fc892200:6687] 1 exiting: rc = 0 00000100:00100000:3.0:1788309607.580802:0:6686:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff97c8fc895a00:6686] 0 exiting: rc = 1 00000100:00100000:1.0:1788309607.581499:0:6688:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff97c8fc893a00:6688] 2 exiting: rc = 0 00000100:00100000:3.0:1788309607.581624:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.581632:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.581639:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.581644:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.581649:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.581655:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.581660:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.581665:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.581670:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.581684:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.581691:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.581696:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.581702:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.581707:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.581713:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.581718:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.581723:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.581728:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.581733:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.581737:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.581742:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.581748:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.581753:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.581758:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.581763:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.581776:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.581782:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.581787:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.581793:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.581798:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.581804:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.581810:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.581815:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.581833:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.581840:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.581845:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.581850:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.581855:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.581861:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.581866:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.581872:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.581878:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.581884:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.581890:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.581895:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.581901:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.581917:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.581923:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.581928:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.581935:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.581940:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.581945:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.581950:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.581956:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.581961:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.581966:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.581971:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.581976:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.581982:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.581988:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.582000:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.582007:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.582013:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.582025:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309607.587131:0:6689:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff97c8d68b4a00:6689] 0 exiting: rc = 1 00000100:00100000:1.0:1788309607.587240:0:6690:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff97c8d68b5e00:6690] 1 exiting: rc = 0 00000100:00100000:3.0:1788309607.587433:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.587442:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.587447:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.587452:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.587457:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.587463:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.587480:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.587486:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.587491:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.587496:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.587500:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.587505:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.587510:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.587515:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.587520:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.587525:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.587530:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.587535:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.587540:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.587544:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.587549:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.587554:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.587559:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.587565:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.587571:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.587576:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.587581:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.587585:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.587705:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.587712:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.587718:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.587735:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.587740:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.587745:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.587750:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.587754:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.587759:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.587764:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.587770:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.587775:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.587780:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.587785:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.587790:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.587796:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.587801:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.587807:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.587812:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.587816:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.587821:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.587827:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.587833:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.587838:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.587842:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.587847:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.587852:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.587857:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.587861:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.587865:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.587870:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.587875:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.587880:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.587885:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.587890:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.587896:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309607.589175:0:6691:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff97c8fc893200:6691] 0 exiting: rc = 1 00000100:00100000:3.0:1788309607.589499:0:6692:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff97c8e68ae600:6692] 1 exiting: rc = 0 00000100:00100000:3.0:1788309607.589561:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.589579:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.589584:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.589605:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.589628:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.589635:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.589642:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.589648:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.589655:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.589660:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.589666:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.589672:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.589678:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.589684:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.589692:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.589697:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.589718:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.589725:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.589732:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.589739:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.589746:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.589752:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.589757:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.589764:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.589770:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.589775:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.589780:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.589786:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.589806:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.589813:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.589819:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.589826:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.589832:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.589838:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.589844:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.589850:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.589864:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.589870:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.589877:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.589883:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.589903:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.589920:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.589925:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.589932:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.589937:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.589943:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.589949:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.589956:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.589961:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.589966:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.589972:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.589978:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.590000:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.590007:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.590012:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.590017:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.590023:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.590029:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.590034:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.590041:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.590047:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.590052:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.590057:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309607.590064:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1788309607.600236:0:13265:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1788309625.813259:0:13882:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg255-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788309633.651824:0:14344:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788309633.651829:0:14344:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1788309633.651943:0:14344:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff97c8ffb11000 00000020:01000004:2.0:1788309633.651961:0:14344:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1788309633.651969:0:14344:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788309633.651983:0:14344:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff97c8d6bd3370) 00000020:00000080:2.0:1788309633.651997:0:14344:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788309633.666006:0:14344:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788309633.668874:0:14344:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1788309633.669730:0:14344:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 575: rc = 0 00100000:10000000:2.0:1788309633.669934:0:14344:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788309633.670017:0:14344:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 575: rc = 0 00100000:10000000:2.0:1788309633.670242:0:14344:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 575: rc = 0 00100000:10000000:2.0:1788309633.670375:0:14344:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 575: rc = 0 00100000:10000000:2.0:1788309633.670480:0:14344:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 575: rc = 0 00100000:10000000:2.0:1788309633.670580:0:14344:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 575: rc = 0 00100000:10000000:2.0:1788309633.670854:0:14344:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 577: rc = 0 00100000:10000000:3.0:1788309633.672385:0:14344:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 769: rc = 0 00100000:10000000:3.0:1788309633.672488:0:14344:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 769: rc = 0 00100000:10000000:3.0:1788309633.672994:0:14344:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 774: rc = 0 00100000:10000000:3.0:1788309633.673613:0:14344:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 774: rc = 0 00100000:10000000:3.0:1788309633.673885:0:14344:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 774: rc = 0 00100000:10000000:3.0:1788309633.674359:0:14344:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 774: rc = 0 00100000:10000000:3.0:1788309633.674603:0:14344:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 774: rc = 0 00100000:10000000:3.0:1788309633.674870:0:14344:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 774: rc = 0 00100000:10000000:3.0:1788309633.675242:0:14344:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 774: rc = 0 00100000:10000000:3.0:1788309633.675575:0:14344:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 774: rc = 0 00100000:10000000:3.0:1788309633.675835:0:14344:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 774: rc = 0 00100000:10000000:3.0:1788309633.676210:0:14344:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 774: rc = 0 00100000:10000000:3.0:1788309633.676496:0:14344:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 774: rc = 0 00100000:10000000:3.0:1788309633.677964:0:14344:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 774: rc = 0 00100000:10000000:3.0:1788309633.678839:0:14344:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 790: rc = 0 00100000:10000000:3.0:1788309633.680312:0:14344:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 790: rc = 0 00100000:10000000:3.0:1788309633.681171:0:14344:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 790: rc = 0 00100000:10000000:3.0:1788309633.681611:0:14344:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 790: rc = 0 00100000:10000000:3.0:1788309633.681974:0:14344:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 790: rc = 0 00100000:10000000:3.0:1788309633.682502:0:14344:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 790: rc = 0 00100000:10000000:3.0:1788309633.682839:0:14344:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 790: rc = 0 00100000:10000000:3.0:1788309633.683385:0:14344:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 790: rc = 0 00100000:10000000:3.0:1788309633.683652:0:14344:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 790: rc = 0 00100000:10000000:3.0:1788309633.683986:0:14344:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 790: rc = 0 00100000:10000000:3.0:1788309633.684468:0:14344:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 790: rc = 0 00100000:10000000:3.0:1788309633.685237:0:14344:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 790: rc = 0 00100000:10000000:3.0:1788309633.686167:0:14344:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 790: rc = 0 00100000:10000000:3.0:1788309633.686418:0:14344:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 790: rc = 0 00100000:10000000:3.0:1788309633.686628:0:14344:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 790: rc = 0 00100000:10000000:3.0:1788309633.688205:0:14344:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 790: rc = 0 00100000:10000000:3.0:1788309633.689177:0:14344:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 790: rc = 0 00100000:10000000:3.0:1788309633.690148:0:14344:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 790: rc = 0 00100000:10000000:3.0:1788309633.690409:0:14344:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 790: rc = 0 00100000:10000000:3.0:1788309633.690658:0:14344:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 790: rc = 0 00100000:10000000:3.0:1788309633.690949:0:14344:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 790: rc = 0 00100000:10000000:3.0:1788309633.694044:0:14344:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 790: rc = 0 00100000:10000000:3.0:1788309633.694336:0:14344:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 790: rc = 0 00100000:10000000:3.0:1788309633.694558:0:14344:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 790: rc = 0 00100000:10000000:3.0:1788309633.694847:0:14344:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 790: rc = 0 00100000:10000000:3.0:1788309633.695082:0:14344:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 790: rc = 0 00100000:10000000:3.0:1788309633.695395:0:14344:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 790: rc = 0 00100000:10000000:3.0:1788309633.695627:0:14344:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 790: rc = 0 00100000:10000000:3.0:1788309633.695904:0:14344:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 790: rc = 0 00100000:10000000:3.0:1788309633.696164:0:14344:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 790: rc = 0 00100000:10000000:3.0:1788309633.696453:0:14344:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 790: rc = 0 00100000:10000000:3.0:1788309633.696716:0:14344:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 790: rc = 0 00100000:10000000:3.0:1788309633.697108:0:14344:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 402: rc = 0 00100000:10000000:3.0:1788309633.697643:0:14344:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1788309633.703203:0:14344:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 715: rc = 0 00100000:10000000:3.0:1788309633.703483:0:14344:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1788309633.703558:0:14344:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 715: rc = 0 00100000:10000000:3.0:1788309633.703772:0:14344:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1788309633.703844:0:14344:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 715: rc = 0 00100000:10000000:3.0:1788309633.704205:0:14344:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1788309633.704272:0:14344:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 770: rc = 0 00100000:10000000:3.0:1788309633.704500:0:14344:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1788309633.704565:0:14344:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 770: rc = 0 00100000:10000000:3.0:1788309633.704780:0:14344:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1788309633.704849:0:14344:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 770: rc = 0 00000020:00000080:3.0:1788309633.705134:0:14344:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788309633.705144:0:14344:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788309633.705155:0:14344:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x63a04852f4629622 00000020:01000004:3.0:1788309633.705163:0:14344:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1788309633.705169:0:14344:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788309633.705175:0:14344:0:(tgt_mount.c:101:server_register_mount()) register mount ffff97c8ffb11000 from MGS 00000020:01000004:3.0:1788309633.705179:0:14344:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788309633.705189:0:14344:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff97c8e661cd28) 00000020:00000080:3.0:1788309633.705199:0:14344:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788309633.705254:0:14344:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97c8ffb11000 from MGS, refs=2 00080000:01000000:3.0:1788309633.705259:0:14344:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788309633.705263:0:14344:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x63a04852f4629630 00000100:00100000:3.0:1788309633.705385:0:14344:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788309633.705521:0:14344:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788309633.705527:0:14344:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788309633.707998:0:14344:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788309633.708135:0:14344:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1788309633.709679:0:14344:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788309633.709961:0:14344:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1788309633.709969:0:14344:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1788309633.710833:0:14344:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1788309633.710843:0:14344:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788309633.711623:0:14344:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788309633.711632:0:14344:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788309633.713306:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309633.713311:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309633.713313:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309633.713730:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309633.713733:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309633.713735:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309633.714377:0:14344:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1788309633.719198:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1788309633.732622:0:14344:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1788309633.732649:0:14344:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788309633.732652:0:14344:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1788309633.735195:0:14353:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788309633.736921:0:14344:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788309633.737186:0:14344:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788309633.739161:0:14344:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788309633.743027:0:14344:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788309633.743193:0:14344:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788309633.743199:0:14344:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788309633.743914:0:14344:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788309633.743923:0:14344:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788309633.744367:0:14344:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788309633.744374:0:14344:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:2.0:1788309633.745146:0:14358:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:0.0:1788309633.745391:0:14344:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788309633.745414:0:14344:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.155@tcp' 00000020:01000004:0.0:1788309633.745416:0:14344:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788309633.745447:0:14344:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.155@tcp (typ=mgc) 00000020:00000080:0.0:1788309633.745461:0:14344:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.155@tcp (ffff97c8f4f319b8) 00000020:00000080:0.0:1788309633.745478:0:14344:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788309633.745555:0:14344:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97c8e6451800@MGC192.168.202.155@tcp: add connection 192.168.202.155@tcp at head 00010000:00010000:0.0:1788309633.746372:0:14344:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.155@tcp-0 is initialized 00000040:01000000:0.0:1788309633.746381:0:14344:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.155@tcp ctxt 1 is initialized 10000000:01000000:0.0:1788309633.752906:0:14360:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788309633.753150:0:14344:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.155@tcp (uuid a1139bce-bc3d-41b1-9121-b11888b6dcf4) 00000020:00000080:1.0:1788309633.753177:0:14344:0:(genops.c:1385:class_connect()) connect: client a1139bce-bc3d-41b1-9121-b11888b6dcf4, cookie 0x63a04852f462963e 00000100:00080000:1.0:1788309633.753189:0:14344:0:(import.c:510:import_select_connection()) MGC192.168.202.155@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788309633.753195:0:14344:0:(import.c:624:import_select_connection()) MGC192.168.202.155@tcp: import ffff97c8e6451800 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:1.0:1788309633.753225:0:14344:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97c8ecb41180 x1875178210545920/t0(0) o250->MGC192.168.202.155@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788309633.753253:0:14344:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import a1139bce-bc3d-41b1-9121-b11888b6dcf4->MGS 00000020:01000004:1.0:1788309633.753270:0:14344:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788309633.753315:0:14344:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788309633.753329:0:14344:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff97c8ecf7b370) 00000020:00000080:1.0:1788309633.753339:0:14344:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788309633.754789:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecb41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a1139bce-bc3d-41b1-9121-b11888b6dcf4:3299:1875178210545920:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788309633.755002:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309633.757227:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210545920 00000100:00100000:3.0:1788309633.757239:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210545920 00000100:00100000:3.0:1788309633.757299:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788309633.757307:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d7212c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3299:x1875178210545920:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1788309633.757335:0:14355:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from a1139bce-bc3d-41b1-9121-b11888b6dcf4@0@lo t0 exp 0000000000000000 cur 396 last 0 00000020:00000080:3.0:1788309633.757372:0:14355:0:(genops.c:1385:class_connect()) connect: client a1139bce-bc3d-41b1-9121-b11888b6dcf4, cookie 0x63a04852f462964c 00000100:00080000:3.0:1788309633.757516:0:14355:0:(import.c:65:import_set_state_nolock()) ffff97c8ed04e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788309633.757630:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d7212c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1139bce-bc3d-41b1-9121-b11888b6dcf4+5:3299:x1875178210545920:12345-0@lo:250:mount.lustre.0 Request processed in 321us (2627us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309633.757638:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788309633.765000:0:3299:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.202.155@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788309633.765019:0:3299:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.155@tcp: connect to target with instance 0 00000100:00080000:0.0:1788309633.765040:0:3299:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.155@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788309633.765046:0:3299:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788309633.765051:0:3299:0:(import.c:65:import_set_state_nolock()) ffff97c8e6451800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788309633.765055:0:3299:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788309633.765063:0:3299:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788309633.765072:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecb41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a1139bce-bc3d-41b1-9121-b11888b6dcf4:3299:1875178210545920:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788309633.797447:0:14344:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788309633.797637:0:14344:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788309633.797643:0:14344:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788309633.801355:0:14344:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788309633.801367:0:14344:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788309633.802872:0:14344:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788309633.802883:0:14344:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1788309633.804340:0:14344:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788309633.804605:0:14344:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1788309633.804623:0:14344:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788309633.819488:0:14344:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788309633.819508:0:14344:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788309633.914539:0:14344:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788309633.914769:0:14344:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788309633.914776:0:14344:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788309633.920512:0:14344:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788309633.920530:0:14344:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788309633.925460:0:14344:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788309633.925902:0:14344:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788309633.925910:0:14344:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788309633.926863:0:14344:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788309633.926873:0:14344:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788309633.927973:0:14344:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788309633.928492:0:14344:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788309633.928497:0:14344:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788309633.929636:0:14344:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788309633.929646:0:14344:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788309633.930684:0:14344:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788309633.930945:0:14344:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788309633.930956:0:14344:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788309633.931852:0:14344:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788309633.931862:0:14344:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788309633.966878:0:14344:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788309633.967365:0:14344:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788309633.967372:0:14344:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788309633.973929:0:14344:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788309633.973943:0:14344:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788309633.975327:0:14344:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788309633.975337:0:14344:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788309633.976435:0:14344:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788309633.976457:0:14344:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1788309633.976463:0:14344:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.155@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788309633.976907:0:14344:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.155@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788309633.976948:0:14344:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.155@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1788309633.976952:0:14344:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788309633.976954:0:14344:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788309633.976956:0:14344:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788309633.976957:0:14344:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788309633.976958:0:14344:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788309633.976960:0:14344:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788309633.976961:0:14344:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788309633.976963:0:14344:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788309633.976965:0:14344:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788309633.976966:0:14344:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788309633.976968:0:14344:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1788309633.976970:0:14344:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788309633.976971:0:14344:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788309633.976972:0:14344:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788309633.976973:0:14344:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788309633.976974:0:14344:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788309633.976975:0:14344:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788309633.976976:0:14344:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788309633.976977:0:14344:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788309633.976979:0:14344:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788309633.976980:0:14344:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788309633.977121:0:14344:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788309633.977142:0:14344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc575180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14344:1875178210546048:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788309633.977226:0:14344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309633.979201:0:14344:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c37fbcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788309633.979524:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210546048 00000100:00100000:2.0:1788309633.979538:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210546048 00000100:00100000:2.0:1788309633.979601:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788309633.979612:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ee53d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1139bce-bc3d-41b1-9121-b11888b6dcf4+5:14344:x1875178210546048:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788309633.980480:0:14357:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788309633.980485:0:14357:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788309633.980489:0:14357:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1788309633.981056:0:14378:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788309633.981554:0:14357:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:3.0:1788309633.983811:0:14379:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1788309633.983820:0:14379:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1788309633.983823:0:14379:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1788309633.983865:0:14379:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:2.0:1788309633.984474:0:14357:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788309633.984486:0:14357:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788309633.992313:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ee53d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1139bce-bc3d-41b1-9121-b11888b6dcf4+5:14344:x1875178210546048:12345-0@lo:253:mount.lustre.0 Request processed in 12690us (15074us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309633.992335:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788309633.992531:0:14344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc575180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14344:1875178210546048:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788309633.992548:0:14344:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788309633.992552:0:14344:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788309633.992553:0:14344:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788309633.992555:0:14344:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788309633.992556:0:14344:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788309633.992557:0:14344:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788309633.992559:0:14344:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788309633.992561:0:14344:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788309633.992562:0:14344:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788309633.992564:0:14344:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788309633.992566:0:14344:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788309633.992587:0:14344:0:(tgt_mount.c:101:server_register_mount()) register mount ffff97c8ffb11000 from lustre-MDT0000 10000000:01000000:3.0:1788309633.992735:0:14344:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788309633.992811:0:14344:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788309633.992816:0:14344:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff97c8f4f319b8 10000000:01000000:3.0:1788309633.992821:0:14344:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788309633.992829:0:14344:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff97c8f4f319b8 from 1 10000000:01000000:3.0:1788309633.992832:0:14344:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788309633.992871:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8c153b600/0x63a04852f4629653 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309633.992884:0:14344:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff97c8c153b600/0x63a04852f4629653 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309633.992915:0:14344:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff97c8c153b600/0x63a04852f4629653 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309633.992937:0:14344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc575180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14344:1875178210546176:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788309633.992978:0:14344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309633.993186:0:14344:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d691b600 going to sleep for 11 seconds 00000100:00100000:2.0:1788309633.993262:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210546176 00000100:00100000:2.0:1788309633.993270:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210546176 00000100:00100000:2.0:1788309633.993410:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788309633.993421:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ee53f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1139bce-bc3d-41b1-9121-b11888b6dcf4+5:14344:x1875178210546176:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788309633.993435:0:14356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309633.993451:0:14356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c8fc935400/0x63a04852f462965a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x63a04852f4629653 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309633.993475:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8fc935400/0x63a04852f462965a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63a04852f4629653 expref: 6 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309633.993487:0:14356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c8fc935400/0x63a04852f462965a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f4629653 expref: 6 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309633.993496:0:14356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8fc935400, rc 0) 00000100:00100000:2.0:1788309633.993542:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ee53f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1139bce-bc3d-41b1-9121-b11888b6dcf4+6:14344:x1875178210546176:12345-0@lo:101:mount.lustre.0 Request processed in 124us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309633.993559:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788309633.993637:0:14344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc575180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14344:1875178210546176:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788309633.993676:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff97c8c153b600/0x63a04852f4629653 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f462965a expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309633.993685:0:14344:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff97c8c153b600/0x63a04852f4629653 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x63a04852f462965a expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309633.993754:0:14344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffbb1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14344:1875178210546304:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788309633.993783:0:14344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309633.994042:0:14344:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d1493a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788309633.994175:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210546304 00000100:00100000:3.0:1788309633.994180:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210546304 00000100:00100000:3.0:1788309633.994204:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788309633.994211:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ee53c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1139bce-bc3d-41b1-9121-b11888b6dcf4+6:14344:x1875178210546304:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788309633.994469:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ee53c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1139bce-bc3d-41b1-9121-b11888b6dcf4+6:14344:x1875178210546304:12345-0@lo:501:mount.lustre.0 Request processed in 257us (684us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788309633.994476:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788309633.994597:0:14344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffbb1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14344:1875178210546304:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788309633.994639:0:14344:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788309633.994660:0:14344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8c153b600/0x63a04852f4629653 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f462965a expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309633.994676:0:14344:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff97c8c153b600/0x63a04852f4629653 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f462965a expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788309633.994684:0:14344:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff97c8ffb11000 10000000:01000000:0.0:1788309633.994689:0:14344:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788309633.994693:0:14344:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff97c8ffb11000 10000000:01000000:0.0:1788309633.994696:0:14344:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788309633.994699:0:14344:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff97c8ffb11000 from 1 10000000:01000000:0.0:1788309633.994702:0:14344:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788309633.994726:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8ecf2f400/0x63a04852f4629661 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309633.994734:0:14344:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff97c8ecf2f400/0x63a04852f4629661 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309633.994764:0:14344:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff97c8ecf2f400/0x63a04852f4629661 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309633.994779:0:14344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffbb1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14344:1875178210546432:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788309633.994808:0:14344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309633.994835:0:14344:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d1493a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788309633.995157:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210546432 00000100:00100000:3.0:1788309633.995163:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210546432 00000100:00100000:3.0:1788309633.995186:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788309633.995193:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ee53e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1139bce-bc3d-41b1-9121-b11888b6dcf4+6:14344:x1875178210546432:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788309633.995202:0:14355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309633.995217:0:14355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c8c153b800/0x63a04852f4629668 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x63a04852f4629661 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309633.995238:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8c153b800/0x63a04852f4629668 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63a04852f4629661 expref: 7 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309633.995249:0:14355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c8c153b800/0x63a04852f4629668 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f4629661 expref: 7 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309633.995268:0:14355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8c153b800, rc 0) 00000100:00100000:3.0:1788309633.995334:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ee53e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1139bce-bc3d-41b1-9121-b11888b6dcf4+7:14344:x1875178210546432:12345-0@lo:101:mount.lustre.0 Request processed in 141us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309633.995341:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788309633.995508:0:14344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffbb1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14344:1875178210546432:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788309633.995522:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff97c8ecf2f400/0x63a04852f4629661 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4629668 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309633.995530:0:14344:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff97c8ecf2f400/0x63a04852f4629661 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x63a04852f4629668 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788309633.995543:0:14344:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788309633.995552:0:14344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8ecf2f400/0x63a04852f4629661 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4629668 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309633.995560:0:14344:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff97c8ecf2f400/0x63a04852f4629661 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4629668 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788309633.995566:0:14344:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788309633.995570:0:14344:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788309633.995574:0:14344:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff97c8ffb11000 10000000:01000000:0.0:1788309633.995577:0:14344:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788309633.995580:0:14344:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788309633.995583:0:14344:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788309633.995599:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8ecf2f600/0x63a04852f462966f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309633.995733:0:14344:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff97c8ecf2f600/0x63a04852f462966f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309633.995810:0:14344:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff97c8ecf2f600/0x63a04852f462966f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309633.995827:0:14344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffbb1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14344:1875178210546560:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788309633.995861:0:14344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309633.995931:0:14344:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d1493a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788309633.996170:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210546560 00000100:00100000:2.0:1788309633.996176:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210546560 00000100:00100000:3.0:1788309633.996223:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788309633.996233:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ee53dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1139bce-bc3d-41b1-9121-b11888b6dcf4+7:14344:x1875178210546560:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788309633.996243:0:14355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309633.996253:0:14355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c8c153b200/0x63a04852f4629676 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x63a04852f462966f expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309633.996271:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8c153b200/0x63a04852f4629676 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63a04852f462966f expref: 8 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309633.996314:0:14355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c8c153b200/0x63a04852f4629676 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f462966f expref: 8 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309633.996322:0:14355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8c153b200, rc 0) 00000100:00100000:3.0:1788309633.996355:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ee53dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1139bce-bc3d-41b1-9121-b11888b6dcf4+8:14344:x1875178210546560:12345-0@lo:101:mount.lustre.0 Request processed in 124us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309633.996360:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788309633.996448:0:14344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffbb1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14344:1875178210546560:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788309633.996460:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff97c8ecf2f600/0x63a04852f462966f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4629676 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309633.996468:0:14344:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff97c8ecf2f600/0x63a04852f462966f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x63a04852f4629676 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309633.996520:0:14344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffbb1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14344:1875178210546688:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788309633.996544:0:14344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309633.996571:0:14344:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d1493a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788309633.996639:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210546688 00000100:00100000:3.0:1788309633.996643:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210546688 00000100:00100000:3.0:1788309633.996862:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788309633.996869:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ee53cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1139bce-bc3d-41b1-9121-b11888b6dcf4+8:14344:x1875178210546688:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788309633.997586:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ee53cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1139bce-bc3d-41b1-9121-b11888b6dcf4+9:14344:x1875178210546688:12345-0@lo:501:mount.lustre.0 Request processed in 715us (1038us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309633.997606:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788309633.997965:0:14344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffbb1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14344:1875178210546688:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788309633.998135:0:14344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffbb1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14344:1875178210546816:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788309633.998182:0:14344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309633.998251:0:14344:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d1493a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788309633.998360:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210546816 00000100:00100000:3.0:1788309633.998365:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210546816 00000100:00100000:3.0:1788309633.998436:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788309633.998445:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ee53f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1139bce-bc3d-41b1-9121-b11888b6dcf4+9:14344:x1875178210546816:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788309633.998964:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ee53f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1139bce-bc3d-41b1-9121-b11888b6dcf4+9:14344:x1875178210546816:12345-0@lo:503:mount.lustre.0 Request processed in 519us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309633.998973:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788309633.999065:0:14344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffbb1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14344:1875178210546816:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788309633.999572:0:14380:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffbb1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14380:1875178210546944:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788309633.999628:0:14380:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309634.000264:0:14380:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d14939c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788309634.000415:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210546944 00000100:00100000:2.0:1788309634.000423:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210546944 00000100:00100000:2.0:1788309634.000460:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788309634.000467:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ee53d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1139bce-bc3d-41b1-9121-b11888b6dcf4+9:14380:x1875178210546944:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788309634.001099:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ee53d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1139bce-bc3d-41b1-9121-b11888b6dcf4+9:14380:x1875178210546944:12345-0@lo:502:llog_process_th.0 Request processed in 529us (1369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309634.001108:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788309634.001238:0:14380:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffbb1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14380:1875178210546944:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788309634.001269:0:14380:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788309634.001373:0:14380:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788309634.001375:0:14380:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788309634.001381:0:14380:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788309634.001384:0:14380:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788309634.001401:0:14380:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff97c8f4f30000) 00000020:00000080:0.0:1788309634.001420:0:14380:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1788309634.001424:0:14380:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788309634.001510:0:14380:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788309634.001518:0:14380:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x63a04852f4629684 00000020:00000080:0.0:1788309634.001917:0:14380:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788309634.001922:0:14380:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788309634.001926:0:14380:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788309634.001927:0:14380:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788309634.001930:0:14380:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788309634.001933:0:14380:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788309634.001934:0:14380:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788309634.001937:0:14380:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788309634.001945:0:14380:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff97c8f4f33370) 00000020:00000080:0.0:1788309634.001955:0:14380:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1788309634.001958:0:14380:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788309634.001961:0:14380:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788309634.001964:0:14380:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788309634.001969:0:14380:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788309634.002122:0:14380:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97c8ffb11000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788309634.002134:0:14380:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff97c8f4f34d28) 00000020:00000080:0.0:1788309634.002143:0:14380:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1788309634.002199:0:14380:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788309634.002208:0:14380:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x63a04852f4629699 00000020:00000080:0.0:1788309634.002416:0:14380:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788309634.002422:0:14380:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788309634.002426:0:14380:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x63a04852f46296a0 00080000:01000000:0.0:1788309634.002431:0:14380:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788309634.002434:0:14380:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x63a04852f46296a7 00010000:00010000:3.0:1788309634.095592:0:14380:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1788309634.096333:0:14380:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:3.0:1788309634.096519:0:14380:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788309634.097226:0:14380:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff97c8e661b370) 00000020:00000080:3.0:1788309634.097244:0:14380:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788309634.097353:0:14380:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788309634.097360:0:14380:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x63a04852f46296b5 00000020:00000080:3.0:1788309634.109254:0:14380:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788309634.130518:0:14380:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x63a04852f46296bc 00000020:00000080:2.0:1788309634.131871:0:14380:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788309634.131885:0:14380:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788309634.131893:0:14380:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788309634.131895:0:14380:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788309634.131899:0:14380:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788309634.131907:0:14380:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788309634.131909:0:14380:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788309634.131914:0:14380:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788309634.131960:0:14380:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788309634.131975:0:14380:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788309634.131978:0:14380:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788309634.131979:0:14380:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788309634.131982:0:14380:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788309634.131984:0:14380:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #10 00000020:01000000:2.0:1788309634.131986:0:14380:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788309634.131988:0:14380:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788309634.131989:0:14380:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788309634.131992:0:14380:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788309634.131993:0:14380:0:(obd_config.c:1563:class_process_config()) marker 10 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788309634.132016:0:14380:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788309634.132197:0:14380:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788309634.132202:0:14380:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788309634.132204:0:14380:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788309634.132209:0:14380:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788309634.132214:0:14380:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.155@tcp to nid 0x20000c0a8ca9b (192.168.202.155@tcp) 00000020:01000000:2.0:1788309634.132243:0:14380:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788309634.132246:0:14380:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788309634.132263:0:14380:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff97c8d6bd0000) 00000020:00000080:2.0:1788309634.132380:0:14380:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1788309634.132390:0:14380:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788309634.132463:0:14380:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788309634.132470:0:14380:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788309634.132476:0:14380:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x63a04852f46296ca 00010000:00080000:2.0:1788309634.132512:0:14380:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97c8fc746000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.155@tcp at head 00010000:00010000:2.0:1788309634.133451:0:14380:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:2.0:1788309634.134263:0:14380:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788309634.134494:0:14380:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788309634.137937:0:14380:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788309634.138448:0:14380:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1788309634.138549:0:14380:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000020:00000080:3.0:1788309634.144596:0:14380:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788309634.144613:0:14380:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788309634.144651:0:14380:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788309634.144680:0:14380:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x63a04852f46296d1 00000100:00080000:3.0:1788309634.144692:0:14380:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788309634.144698:0:14380:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff97c8fc746000 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:3.0:1788309634.144871:0:14380:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97c8fc574000 x1875178210547072/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788309634.144918:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc574000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875178210547072:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788309634.144973:0:3299:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875178210547072 offset 0 length 520: 4 00000100:00080000:3.0:1788309634.145170:0:14380:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788309634.145238:0:14380:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788309634.145244:0:14380:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788309634.145246:0:14380:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788309634.145249:0:14380:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788309634.145252:0:14380:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:3.0:1788309634.145253:0:14380:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788309634.145255:0:14380:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788309634.145257:0:14380:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788309634.145259:0:14380:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788309634.145261:0:14380:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788309634.145263:0:14380:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788309634.145267:0:14380:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788309634.145271:0:14380:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788309634.145272:0:14380:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788309634.145299:0:14380:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788309634.145304:0:14380:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.155@tcp to nid 0x20000c0a8ca9b (192.168.202.155@tcp) 00000020:01000000:3.0:1788309634.145326:0:14380:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788309634.145329:0:14380:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788309634.145341:0:14380:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff97c8e66199b8) 00000020:00000080:3.0:1788309634.145353:0:14380:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1788309634.145358:0:14380:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788309634.145413:0:14380:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788309634.145419:0:14380:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788309634.145425:0:14380:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x63a04852f46296df 00010000:00080000:3.0:1788309634.145454:0:14380:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97c8d693f800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.155@tcp at head 00010000:00010000:3.0:1788309634.145689:0:14380:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1788309634.146272:0:14380:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788309634.146320:0:14380:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788309634.147429:0:14380:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788309634.147509:0:14380:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1788309634.148442:0:14384:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788309634.148449:0:14384:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000040:00080000:3.0:1788309634.151216:0:14380:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1788309634.152387:0:14386:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788309634.152395:0:14386:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788309634.153450:0:14380:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788309634.153468:0:14380:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788309634.153507:0:14380:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788309634.153530:0:14380:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x63a04852f46296e6 00000100:00080000:3.0:1788309634.153541:0:14380:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788309634.153548:0:14380:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff97c8d693f800 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:3.0:1788309634.153686:0:14380:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97c8fc576300 x1875178210547200/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788309634.153821:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc576300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875178210547200:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788309634.153889:0:3299:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875178210547200 offset 0 length 520: 4 00000100:00080000:3.0:1788309634.153949:0:14380:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788309634.154045:0:14380:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788309634.154050:0:14380:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788309634.154052:0:14380:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788309634.154055:0:14380:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788309634.154060:0:14380:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788309634.154061:0:14380:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788309634.154064:0:14380:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788309634.154066:0:14380:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788309634.154069:0:14380:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788309634.154071:0:14380:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788309634.154072:0:14380:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788309634.154074:0:14380:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788309634.154076:0:14380:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788309634.154078:0:14380:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788309634.154082:0:14380:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788309634.154116:0:14380:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc575c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14380:1875178210547328:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788309634.154169:0:14380:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309634.154196:0:14380:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d691ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1788309634.154335:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210547328 00000100:00100000:2.0:1788309634.154345:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210547328 00000100:00100000:2.0:1788309634.154396:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788309634.154406:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ee53ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1139bce-bc3d-41b1-9121-b11888b6dcf4+9:14380:x1875178210547328:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788309634.154696:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ee53ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1139bce-bc3d-41b1-9121-b11888b6dcf4+9:14380:x1875178210547328:12345-0@lo:502:llog_process_th.0 Request processed in 291us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309634.154705:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788309634.155163:0:14380:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc575c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14380:1875178210547328:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788309634.155190:0:14380:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788309634.155197:0:14380:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788309634.155204:0:14380:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788309634.155210:0:14380:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1788309634.155470:0:14344:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1788309634.155489:0:14344:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788309634.155517:0:14344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8ecf2f600/0x63a04852f462966f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4629676 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309634.155528:0:14344:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff97c8ecf2f600/0x63a04852f462966f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4629676 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788309634.155536:0:14344:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff97c8ffb11000 from 1 10000000:01000000:2.0:1788309634.155539:0:14344:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788309634.155569:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8fc935600/0x63a04852f46296ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309634.155704:0:14344:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff97c8fc935600/0x63a04852f46296ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309634.155716:0:14344:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff97c8fc935600/0x63a04852f46296ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309634.155733:0:14344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14344:1875178210547456:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788309634.155859:0:14344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309634.155887:0:14344:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8ffc8b240 going to sleep for 11 seconds 00000100:00100000:1.0:1788309634.156011:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210547456 00000100:00100000:1.0:1788309634.156024:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210547456 00000100:00100000:1.0:1788309634.156060:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788309634.156069:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ee53c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1139bce-bc3d-41b1-9121-b11888b6dcf4+9:14344:x1875178210547456:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788309634.156081:0:14357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788309634.156105:0:14357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c8f5548200/0x63a04852f46296f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x63a04852f46296ed expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309634.156129:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8f5548200/0x63a04852f46296f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63a04852f46296ed expref: 10 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309634.156140:0:14357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c8f5548200/0x63a04852f46296f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f46296ed expref: 10 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309634.156149:0:14357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8f5548200, rc 0) 00000100:00100000:1.0:1788309634.156183:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ee53c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1139bce-bc3d-41b1-9121-b11888b6dcf4+10:14344:x1875178210547456:12345-0@lo:101:mount.lustre.0 Request processed in 116us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309634.156191:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788309634.156435:0:14344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14344:1875178210547456:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788309634.156450:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff97c8fc935600/0x63a04852f46296ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f46296f4 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309634.156459:0:14344:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff97c8fc935600/0x63a04852f46296ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x63a04852f46296f4 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309634.157214:0:14344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14344:1875178210547584:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788309634.157265:0:14344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309634.157472:0:14344:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8ffc8b240 going to sleep for 11 seconds 00000100:00100000:3.0:1788309634.157632:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210547584 00000100:00100000:3.0:1788309634.157639:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210547584 00000100:00100000:3.0:1788309634.157720:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788309634.157729:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ee53e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1139bce-bc3d-41b1-9121-b11888b6dcf4+10:14344:x1875178210547584:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788309634.157756:0:14355:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788309634.157763:0:14355:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788309634.157948:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ee53e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1139bce-bc3d-41b1-9121-b11888b6dcf4+10:14344:x1875178210547584:12345-0@lo:256:mount.lustre.0 Request processed in 220us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309634.157955:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788309634.158028:0:14344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14344:1875178210547584:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788309634.158644:0:14344:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788309634.158678:0:14344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8fc935600/0x63a04852f46296ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f46296f4 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309634.158689:0:14344:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff97c8fc935600/0x63a04852f46296ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f46296f4 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788309634.158697:0:14344:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97c8ffb11000 from 1 10000000:01000000:2.0:1788309634.158700:0:14344:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788309634.158730:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8fc934800/0x63a04852f46296fb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309634.158747:0:14344:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff97c8fc934800/0x63a04852f46296fb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309634.158758:0:14344:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff97c8fc934800/0x63a04852f46296fb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309634.158776:0:14344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14344:1875178210547712:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788309634.158816:0:14344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309634.159211:0:14344:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8ffc8b240 going to sleep for 11 seconds 00000100:00100000:1.0:1788309634.159298:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210547712 00000100:00100000:1.0:1788309634.159305:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210547712 00000100:00100000:1.0:1788309634.159337:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788309634.159345:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ee53e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1139bce-bc3d-41b1-9121-b11888b6dcf4+10:14344:x1875178210547712:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788309634.159355:0:14357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788309634.159369:0:14357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c8f5549200/0x63a04852f4629702 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x63a04852f46296fb expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309634.159391:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8f5549200/0x63a04852f4629702 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63a04852f46296fb expref: 11 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309634.159401:0:14357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c8f5549200/0x63a04852f4629702 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f46296fb expref: 11 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309634.159410:0:14357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8f5549200, rc 0) 00000100:00100000:1.0:1788309634.159442:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ee53e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1139bce-bc3d-41b1-9121-b11888b6dcf4+11:14344:x1875178210547712:12345-0@lo:101:mount.lustre.0 Request processed in 98us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309634.159462:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788309634.159546:0:14344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14344:1875178210547712:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788309634.159560:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff97c8fc934800/0x63a04852f46296fb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4629702 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309634.159570:0:14344:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff97c8fc934800/0x63a04852f46296fb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x63a04852f4629702 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309634.159644:0:14344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14344:1875178210547840:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788309634.159679:0:14344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309634.159705:0:14344:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8ffc8b240 going to sleep for 11 seconds 00000100:00100000:1.0:1788309634.159762:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210547840 00000100:00100000:1.0:1788309634.159767:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210547840 00000100:00100000:1.0:1788309634.159782:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788309634.159787:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ee53fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1139bce-bc3d-41b1-9121-b11888b6dcf4+11:14344:x1875178210547840:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788309634.160470:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ee53fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1139bce-bc3d-41b1-9121-b11888b6dcf4+11:14344:x1875178210547840:12345-0@lo:501:mount.lustre.0 Request processed in 680us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309634.160478:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788309634.160624:0:14344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14344:1875178210547840:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788309634.160657:0:14344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14344:1875178210547968:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788309634.160706:0:14344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309634.160816:0:14344:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8ffc8b240 going to sleep for 11 seconds 00000100:00100000:3.0:1788309634.160852:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210547968 00000100:00100000:3.0:1788309634.160856:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210547968 00000100:00100000:3.0:1788309634.160920:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788309634.160928:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f522f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1139bce-bc3d-41b1-9121-b11888b6dcf4+11:14344:x1875178210547968:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788309634.161192:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f522f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1139bce-bc3d-41b1-9121-b11888b6dcf4+11:14344:x1875178210547968:12345-0@lo:503:mount.lustre.0 Request processed in 265us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309634.161198:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788309634.161259:0:14344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14344:1875178210547968:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788309634.161586:0:14388:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14388:1875178210548096:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788309634.161622:0:14388:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309634.161841:0:14388:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8ffc8b840 going to sleep for 11 seconds 00000100:00100000:1.0:1788309634.161913:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210548096 00000100:00100000:1.0:1788309634.161918:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210548096 00000100:00100000:1.0:1788309634.161943:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788309634.161950:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f522c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1139bce-bc3d-41b1-9121-b11888b6dcf4+11:14388:x1875178210548096:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788309634.162298:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f522c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1139bce-bc3d-41b1-9121-b11888b6dcf4+11:14388:x1875178210548096:12345-0@lo:502:llog_process_th.0 Request processed in 328us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309634.162305:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788309634.162389:0:14388:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14388:1875178210548096:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788309634.162413:0:14388:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788309634.162422:0:14388:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788309634.162425:0:14388:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788309634.162431:0:14388:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97c8ffb11000 00000020:00000080:2.0:1788309634.162434:0:14388:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788309634.162443:0:14388:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788309634.162446:0:14388:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788309634.162447:0:14388:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788309634.162449:0:14388:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788309634.162451:0:14388:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788309634.162452:0:14388:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788309634.162455:0:14388:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97c8ffb11000 00000020:00000080:2.0:1788309634.162457:0:14388:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788309634.162522:0:14388:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788309634.162526:0:14388:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788309634.162527:0:14388:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788309634.162530:0:14388:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788309634.162532:0:14388:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788309634.162533:0:14388:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788309634.162537:0:14388:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff97c8ffb11000 00000020:00000080:2.0:1788309634.162539:0:14388:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788309634.162587:0:14388:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14388:1875178210548224:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788309634.162626:0:14388:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309634.162646:0:14388:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8ffc8b840 going to sleep for 11 seconds 00000100:00100000:3.0:1788309634.165837:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210548224 00000100:00100000:3.0:1788309634.165852:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210548224 00000100:00100000:3.0:1788309634.165908:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788309634.165918:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f522e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1139bce-bc3d-41b1-9121-b11888b6dcf4+11:14388:x1875178210548224:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788309634.166206:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f522e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1139bce-bc3d-41b1-9121-b11888b6dcf4+11:14388:x1875178210548224:12345-0@lo:502:llog_process_th.0 Request processed in 288us (3578us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309634.166214:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788309634.170229:0:14388:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14388:1875178210548224:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788309634.170306:0:14388:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788309634.170316:0:14388:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788309634.170318:0:14388:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788309634.170323:0:14388:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1788309634.171351:0:14344:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788309634.171377:0:14344:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788309634.171395:0:14344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8fc934800/0x63a04852f46296fb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4629702 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309634.171408:0:14344:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff97c8fc934800/0x63a04852f46296fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4629702 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788309634.171453:0:14344:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788309634.171456:0:14344:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff97c8ffb11000 10000000:01000000:2.0:1788309634.171459:0:14344:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff97c8ffb11000 10000000:01000000:2.0:1788309634.171464:0:14344:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788309634.171470:0:14344:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97c8ffb11000 from 1 10000000:01000000:2.0:1788309634.171473:0:14344:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788309634.171514:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8fc934e00/0x63a04852f4629709 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309634.171523:0:14344:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff97c8fc934e00/0x63a04852f4629709 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309634.171532:0:14344:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff97c8fc934e00/0x63a04852f4629709 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309634.171555:0:14344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14344:1875178210548352:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788309634.171624:0:14344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309634.171681:0:14344:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8ffc8bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788309634.171835:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210548352 00000100:00100000:0.0:1788309634.171844:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210548352 00000100:00100000:0.0:1788309634.171899:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788309634.171910:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f522fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1139bce-bc3d-41b1-9121-b11888b6dcf4+11:14344:x1875178210548352:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788309634.171925:0:14356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788309634.171941:0:14356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c8ecf2f000/0x63a04852f4629710 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x63a04852f4629709 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309634.171964:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8ecf2f000/0x63a04852f4629710 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63a04852f4629709 expref: 12 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309634.171975:0:14356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c8ecf2f000/0x63a04852f4629710 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f4629709 expref: 12 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309634.171983:0:14356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8ecf2f000, rc 0) 00000100:00100000:0.0:1788309634.185612:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f522fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1139bce-bc3d-41b1-9121-b11888b6dcf4+12:14344:x1875178210548352:12345-0@lo:101:mount.lustre.0 Request processed in 13695us (13979us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309634.185643:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788309634.185959:0:14344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14344:1875178210548352:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788309634.185985:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff97c8fc934e00/0x63a04852f4629709 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4629710 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309634.186110:0:14344:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff97c8fc934e00/0x63a04852f4629709 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x63a04852f4629710 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309634.186188:0:14344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14344:1875178210548480:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788309634.186243:0:14344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309634.186347:0:14344:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8ffc8bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788309634.196858:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210548480 00000100:00100000:0.0:1788309634.196876:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210548480 00000100:00100000:0.0:1788309634.196949:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788309634.196960:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f522ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1139bce-bc3d-41b1-9121-b11888b6dcf4+12:14344:x1875178210548480:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788309634.198500:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f522ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1139bce-bc3d-41b1-9121-b11888b6dcf4+12:14344:x1875178210548480:12345-0@lo:501:mount.lustre.0 Request processed in 1532us (12248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309634.198513:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788309634.199359:0:14344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14344:1875178210548480:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788309634.199410:0:14344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc575c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14344:1875178210548608:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788309634.199464:0:14344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309634.199501:0:14344:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d691bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788309634.199548:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210548608 00000100:00100000:0.0:1788309634.199554:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210548608 00000100:00100000:0.0:1788309634.199601:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788309634.199609:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f522d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1139bce-bc3d-41b1-9121-b11888b6dcf4+12:14344:x1875178210548608:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788309634.199836:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f522d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1139bce-bc3d-41b1-9121-b11888b6dcf4+12:14344:x1875178210548608:12345-0@lo:503:mount.lustre.0 Request processed in 227us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309634.199844:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788309634.201151:0:14344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc575c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14344:1875178210548608:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788309634.204491:0:14393:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecb40000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14393:1875178210548736:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788309634.204588:0:14393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309634.204626:0:14393:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c2f3f780 going to sleep for 11 seconds 00000100:00100000:0.0:1788309634.206424:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210548736 00000100:00100000:0.0:1788309634.206438:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210548736 00000100:00100000:0.0:1788309634.206495:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788309634.206506:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f522e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1139bce-bc3d-41b1-9121-b11888b6dcf4+12:14393:x1875178210548736:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788309634.207677:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f522e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1139bce-bc3d-41b1-9121-b11888b6dcf4+12:14393:x1875178210548736:12345-0@lo:502:llog_process_th.0 Request processed in 1160us (3089us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309634.207689:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788309634.217352:0:14393:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecb40000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14393:1875178210548736:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1788309634.217495:0:14393:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788309634.217513:0:14393:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff97c8ecf7cd28) 00000020:00000080:1.0:1788309634.217533:0:14393:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:1.0:1788309634.217641:0:14393:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97c8ffb11000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788309634.217646:0:14393:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97c8ffb11000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788309634.217649:0:14393:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97c8ffb11000 4 00010000:00080000:1.0:1788309634.217697:0:14393:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97c8ecdbc000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.155@tcp at head 00010000:00010000:1.0:1788309634.224474:0:14393:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:1.0:1788309634.226158:0:14393:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788309634.226201:0:14393:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788309634.226216:0:14393:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x63a04852f462971e 00000100:00080000:1.0:1788309634.226229:0:14393:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788309634.226235:0:14393:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff97c8ecdbc000 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:1.0:1788309634.226272:0:14393:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97c8ecb40000 x1875178210548864/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788309634.226317:0:14393:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788309634.226359:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecb40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875178210548864:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788309634.226436:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309634.226866:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210548864 00000100:00100000:1.0:1788309634.226874:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210548864 00000100:00100000:1.0:1788309634.226945:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788309634.226952:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffbb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3299:x1875178210548864:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788309634.227035:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffbb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3299:x1875178210548864:12345-0@lo:38:llog_process_th.0 Request processed in 81us (599us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788309634.227043:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788309634.231110:0:3299:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788309634.231133:0:3299:0:(import.c:65:import_set_state_nolock()) ffff97c8ecdbc000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788309634.231141:0:3299:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788309634.231146:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecb40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875178210548864:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788309634.235616:0:14393:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffbb0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14393:1875178210548992:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788309634.235795:0:14393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309634.235951:0:14393:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d1493a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788309634.236127:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210548992 00000100:00100000:3.0:1788309634.236137:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210548992 00000100:00100000:3.0:1788309634.236206:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788309634.236218:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f522d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1139bce-bc3d-41b1-9121-b11888b6dcf4+12:14393:x1875178210548992:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788309634.239243:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f522d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1139bce-bc3d-41b1-9121-b11888b6dcf4+12:14393:x1875178210548992:12345-0@lo:502:llog_process_th.0 Request processed in 3019us (3440us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309634.239258:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788309634.239344:0:14393:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffbb0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14393:1875178210548992:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788309634.239385:0:14393:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788309634.239846:0:14344:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788309634.239870:0:14344:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788309634.239893:0:14344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8fc934e00/0x63a04852f4629709 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4629710 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309634.239905:0:14344:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff97c8fc934e00/0x63a04852f4629709 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4629710 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788309634.239975:0:14344:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788309634.239977:0:14344:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788309634.239979:0:14344:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788309634.239980:0:14344:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788309634.239981:0:14344:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788309634.239982:0:14344:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788309634.239983:0:14344:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788309634.239985:0:14344:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788309634.239987:0:14344:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788309634.239988:0:14344:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788309634.239992:0:14344:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1788309634.240004:0:14344:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788309634.240006:0:14344:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788309634.240008:0:14344:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788309634.240009:0:14344:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788309634.240010:0:14344:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788309634.240011:0:14344:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788309634.240012:0:14344:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788309634.240013:0:14344:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788309634.240014:0:14344:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788309634.240015:0:14344:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788309634.240109:0:14344:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788309634.240127:0:14344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14344:1875178210549120:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788309634.240181:0:14344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309634.240266:0:14344:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8ffc8b840 going to sleep for 11 seconds 00000100:00100000:1.0:1788309634.240991:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210549120 00000100:00100000:1.0:1788309634.241110:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210549120 00000100:00100000:1.0:1788309634.241171:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788309634.241182:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f522c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1139bce-bc3d-41b1-9121-b11888b6dcf4+12:14344:x1875178210549120:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788309634.241212:0:14357:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788309634.241228:0:14357:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788309634.285191:0:14357:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788309634.285216:0:14357:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788309634.285758:0:14378:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788309634.285765:0:14378:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788309634.285797:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97c8ecf2f200/0x63a04852f4629725 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309634.285821:0:14378:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c8f5548200/0x63a04852f46296f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f46296ed expref: 12 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309634.285830:0:14378:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97c8ecf2f200/0x63a04852f4629725 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309634.285875:0:14378:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c8f5548200/0x63a04852f46296f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x63a04852f46296ed expref: 12 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309634.285890:0:14378:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97c8f5548200/0x63a04852f46296f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x63a04852f46296ed expref: 12 pid: 14357 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309634.285906:0:14378:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffbb3480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14378:1875178210549248:0@lo:104: 00000100:00100000:0.0:1788309634.286008:0:14378:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309634.286052:0:14378:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c3522180 going to sleep for 11 seconds 00000100:00100000:0.0:1788309634.286319:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210549248 00000100:00100000:0.0:1788309634.286327:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210549248 00000100:00100000:0.0:1788309634.286418:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788309634.286429:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffbb3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a1139bce-bc3d-41b1-9121-b11888b6dcf4+3:14378:x1875178210549248:12345-0@lo:104: 00010000:00010000:0.0:1788309634.286458:0:14345:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff97c8fc935600/0x63a04852f46296ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x63a04852f46296f4 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309634.290357:0:14345:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788309634.290378:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffbb3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a1139bce-bc3d-41b1-9121-b11888b6dcf4+3:14378:x1875178210549248:12345-0@lo:104: Request processed in 3945us (4365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309634.290392:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788309634.290936:0:14378:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffbb3480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14378:1875178210549248:0@lo:104: 00010000:00010000:0.0:1788309634.290962:0:14378:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97c8ecf2f200/0x63a04852f4629725 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309634.291259:0:14351:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788309634.291270:0:14351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff97c8fc935600/0x63a04852f46296ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x63a04852f46296f4 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309634.291301:0:14351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8fc935600 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:2.0:1788309634.291306:0:14351:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff97c8fc935600/0x63a04852f46296ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x63a04852f46296f4 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309634.291337:0:14351:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff97c8fc935600/0x63a04852f46296ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x63a04852f46296f4 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788309634.291345:0:14351:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff97c8fc935600/0x63a04852f46296ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x63a04852f46296f4 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788309634.291351:0:14351:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788309634.292095:0:14351:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff97c8fc935600/0x63a04852f46296ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f46296f4 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309634.292106:0:14351:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788309634.292132:0:14351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff97c8fc935600/0x63a04852f46296ed lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f46296f4 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309634.292140:0:14351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff97c8fc935600/0x63a04852f46296ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f46296f4 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309634.292159:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309634.292161:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309634.292163:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788309634.292195:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a1139bce-bc3d-41b1-9121-b11888b6dcf4:3300:1875178210549376:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788309634.292264:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309634.293823:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210549376 00000100:00100000:0.0:1788309634.293842:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210549376 00010000:00010000:0.0:1788309634.293892:0:14347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c8f5548200/0x63a04852f46296f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63a04852f46296ed expref: 13 pid: 14357 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309634.293946:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788309634.293959:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8eff0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1139bce-bc3d-41b1-9121-b11888b6dcf4+13:3300:x1875178210549376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788309634.293975:0:14347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788309634.293982:0:14347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c8f5548200/0x63a04852f46296f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63a04852f46296ed expref: 13 pid: 14357 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309634.293995:0:14347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c8f5548200/0x63a04852f46296f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x63a04852f46296ed expref: 13 pid: 14357 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309634.294015:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c8f5548200/0x63a04852f46296f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x63a04852f46296ed expref: 13 pid: 14357 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309634.294032:0:14347:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97c8ecf2f200/0x63a04852f4629725 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309634.294048:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8ecf2f200/0x63a04852f4629725 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788309634.294066:0:14347:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008301366s 00010000:00010000:0.0:1788309634.294070:0:14347:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97c8ecf2f200/0x63a04852f4629725 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309634.294078:0:14347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97c8ecf2f200/0x63a04852f4629725 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309634.294084:0:14347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97c8ecf2f200/0x63a04852f4629725 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309634.294091:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97c8ecf2f200/0x63a04852f4629725 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309634.294098:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8ecf2f200 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:0.0:1788309634.294103:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97c8ecf2f200/0x63a04852f4629725 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309634.294111:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97c8ecf2f200/0x63a04852f4629725 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309634.294134:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97c8ecf2f200/0x63a04852f4629725 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309634.294145:0:14347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788309634.294166:0:14378:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97c8ecf2f200/0x63a04852f4629725 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309634.294174:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97c8ecf2f200/0x63a04852f4629725 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309634.294180:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c8ecf2f200/0x63a04852f4629725 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309634.294220:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8eff0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1139bce-bc3d-41b1-9121-b11888b6dcf4+12:3300:x1875178210549376:12345-0@lo:103:ldlm_bl.0 Request processed in 264us (1956us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309634.294228:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788309634.294259:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a1139bce-bc3d-41b1-9121-b11888b6dcf4:3300:1875178210549376:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788309634.322079:0:14344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14344:1875178210549120:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788309634.322093:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f522c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1139bce-bc3d-41b1-9121-b11888b6dcf4+11:14344:x1875178210549120:12345-0@lo:253:mount.lustre.0 Request processed in 80912us (81910us total) trans 0 rc 0/0 10000000:01000000:2.0:1788309634.322099:0:14344:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788309634.322102:0:14344:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788309634.322104:0:14344:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788309634.322105:0:14344:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788309634.322107:0:14344:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000100:00100000:0.0:1788309634.322107:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000020:01000004:2.0:1788309634.322108:0:14344:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788309634.322110:0:14344:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788309634.322111:0:14344:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788309634.322113:0:14344:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788309634.322115:0:14344:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788309634.322117:0:14344:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788309634.322134:0:14344:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788309634.327993:0:14344:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1788309634.328240:0:14344:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788309634.328771:0:14344:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1788309634.329977:0:14344:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788309634.330586:0:14344:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1788309634.330828:0:14344:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1788309634.331646:0:14344:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1788309634.331900:0:14344:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1788309634.332177:0:14344:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1788309634.332440:0:14344:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1788309634.332728:0:14344:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1788309634.333186:0:14344:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:0.0:1788309634.373928:0:14344:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1788309634.374312:0:14344:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1788309634.374545:0:14399:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1788309634.374549:0:14399:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:3.0:1788309634.374735:0:14400:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1788309634.374809:0:14400:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1788309634.377968:0:14344:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788309634.378108:0:14344:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788309634.378473:0:14344:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788309634.378480:0:14344:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788309634.379598:0:14400:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788309634.379690:0:14400:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788309634.379695:0:14400:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:0.0:1788309634.380855:0:14344:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788309634.382093:0:14344:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788309634.382856:0:14344:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788309634.382902:0:14344:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:0.0:1788309634.384800:0:14344:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:0.0:1788309634.389727:0:14344:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1788309634.435062:0:14344:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788309634.435116:0:14344:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbd5e01dab988 00100000:10000000:1.0:1788309634.435127:0:14344:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788309634.436424:0:14344:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788309634.436442:0:14344:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.155@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788309634.436458:0:14344:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1788309634.436477:0:14344:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1788309634.720725:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788309635.237992:0:14394:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:3.0:1788309635.744452:0:14360:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788309635.744462:0:14360:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff97c8ffb11000 from 6 10000000:01000000:3.0:1788309635.744467:0:14360:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788309635.744517:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8c153a200/0x63a04852f462972c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309635.744546:0:14360:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff97c8c153a200/0x63a04852f462972c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309635.744559:0:14360:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff97c8c153a200/0x63a04852f462972c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309635.744588:0:14360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc575c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14360:1875178210549504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788309635.744686:0:14360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309635.744755:0:14360:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c94ad480 going to sleep for 11 seconds 00010000:00010000:2.0:1788309635.744976:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788309635.745047:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210549504 00000100:00100000:0.0:1788309635.745054:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210549504 00000100:00100000:0.0:1788309635.745116:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788309635.745127:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f522dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1139bce-bc3d-41b1-9121-b11888b6dcf4+11:14360:x1875178210549504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788309635.745140:0:14355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788309635.745154:0:14355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c8ecf2e400/0x63a04852f4629733 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x63a04852f462972c expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309635.745174:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8ecf2e400/0x63a04852f4629733 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63a04852f462972c expref: 12 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309635.745197:0:14355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c8ecf2e400/0x63a04852f4629733 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f462972c expref: 12 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309635.745206:0:14355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8ecf2e400, rc 0) 00000100:00100000:0.0:1788309635.745257:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f522dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1139bce-bc3d-41b1-9121-b11888b6dcf4+12:14360:x1875178210549504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309635.745264:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788309635.745424:0:14360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc575c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14360:1875178210549504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788309635.745440:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff97c8c153a200/0x63a04852f462972c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4629733 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309635.745450:0:14360:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff97c8c153a200/0x63a04852f462972c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x63a04852f4629733 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309635.745507:0:14360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc575c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14360:1875178210549632:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788309635.745539:0:14360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309635.745566:0:14360:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c94ad480 going to sleep for 11 seconds 00000100:00100000:0.0:1788309635.745817:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210549632 00000100:00100000:0.0:1788309635.745822:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210549632 00000100:00100000:0.0:1788309635.745892:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788309635.745899:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f522cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1139bce-bc3d-41b1-9121-b11888b6dcf4+12:14360:x1875178210549632:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788309635.745914:0:14357:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788309635.745931:0:14357:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788309635.745934:0:14357:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1788309635.746027:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f522cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1139bce-bc3d-41b1-9121-b11888b6dcf4+12:14360:x1875178210549632:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 128us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309635.746035:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788309635.746096:0:14360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc575c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14360:1875178210549632:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788309635.746155:0:14360:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788309635.746162:0:14360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8c153a200/0x63a04852f462972c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4629733 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309635.746171:0:14360:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff97c8c153a200/0x63a04852f462972c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4629733 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788309636.258689:0:14394:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788309636.770084:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309637.793876:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788309638.523243:0:14643:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg255-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788309638.824372:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788309639.648986:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc575880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a1139bce-bc3d-41b1-9121-b11888b6dcf4:3301:1875178210549760:0@lo:400:kworker.0 00000100:00100000:0.0:1788309639.649073:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309639.649156:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210549760 00000100:00100000:1.0:1788309639.649166:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210549760 00000100:00100000:1.0:1788309639.649236:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788309639.649248:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f522d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1139bce-bc3d-41b1-9121-b11888b6dcf4+12:3301:x1875178210549760:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788309639.649373:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788309639.649379:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788309639.649382:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788309639.649386:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788309639.649389:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788309639.649402:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788309639.649405:0:38:0:(import.c:65:import_set_state_nolock()) ffff97c8ecdbc000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788309639.649414:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff97c8ecdbc000 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:3.0:1788309639.649440:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97c8fc574a80 x1875178210549888/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788309639.649479:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc574a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875178210549888:0@lo:38:kworker.0 00000100:00100000:3.0:1788309639.649706:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309639.649868:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210549888 00000100:00100000:2.0:1788309639.649874:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210549888 00000100:00100000:2.0:1788309639.649896:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788309639.649902:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc575c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3299:x1875178210549888:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788309639.649924:0:14364:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 402 last 0 00000020:00000080:2.0:1788309639.650689:0:14364:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x63a04852f462973a 00000004:00100000:2.0:1788309639.650705:0:14364:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788309639.650844:0:14364:0:(import.c:65:import_set_state_nolock()) ffff97c8f5503800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788309639.650906:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc575c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875178210549888:12345-0@lo:38:kworker.0 Request processed in 1002us (1355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309639.650920:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788309639.650975:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff97c8fc574a80 x1875178210549888/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788309649 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788309639.650990:0:3299:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788309639.650996:0:3299:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788309639.651000:0:3299:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788309639.651002:0:3299:0:(import.c:65:import_set_state_nolock()) ffff97c8ecdbc000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788309639.651008:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc574a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875178210549888:0@lo:38:kworker.0 00000100:00100000:1.0:1788309639.657957:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f522d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1139bce-bc3d-41b1-9121-b11888b6dcf4+12:3301:x1875178210549760:12345-0@lo:400:kworker.0 Request processed in 8703us (8874us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309639.657983:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788309639.664056:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc575880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a1139bce-bc3d-41b1-9121-b11888b6dcf4:3301:1875178210549760:0@lo:400:kworker.0 00010000:00010000:0.0:1788309639.843893:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309640.864497:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309641.888623:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788309641.976629:0:14793:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe17191450 20000000:00000080:3.0:1788309641.976646:0:14793:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff97c8f644f800 uarg=0000000000000000 20000000:01000000:3.0:1788309641.976683:0:14793:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788309641.976690:0:14793:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788309641.976695:0:14793:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788309641.998911:0:14794:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:0.0:1788309641.999321:0:14793:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788309642.013143:0:14793:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788309642.016120:0:14793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97c8f5549c00/0x63a04852f4629741 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309642.016148:0:14793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c8f5549200/0x63a04852f4629702 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f46296fb expref: 11 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309642.016159:0:14793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97c8f5549c00/0x63a04852f4629741 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309642.017072:0:14793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c8f5549200/0x63a04852f4629702 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x63a04852f46296fb expref: 11 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309642.017089:0:14793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97c8f5549200/0x63a04852f4629702 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x63a04852f46296fb expref: 11 pid: 14357 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309642.017105:0:14793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecb41c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14793:1875178210550016:0@lo:104: 00000100:00100000:1.0:1788309642.017175:0:14793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309642.018087:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210550016 00000100:00100000:0.0:1788309642.018098:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210550016 00000100:00100000:0.0:1788309642.018170:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788309642.018181:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecb42d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a1139bce-bc3d-41b1-9121-b11888b6dcf4+3:14793:x1875178210550016:12345-0@lo:104: 00010000:00010000:0.0:1788309642.018206:0:14345:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff97c8fc934800/0x63a04852f46296fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x63a04852f4629702 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309642.021080:0:14793:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d6aee3c0 going to sleep for 11 seconds 00010000:00010000:3.0:1788309642.021659:0:14345:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788309642.021672:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecb42d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a1139bce-bc3d-41b1-9121-b11888b6dcf4+3:14793:x1875178210550016:12345-0@lo:104: Request processed in 3490us (4493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309642.021688:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788309642.021795:0:14793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecb41c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14793:1875178210550016:0@lo:104: 00010000:00010000:2.0:1788309642.021821:0:14793:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97c8f5549c00/0x63a04852f4629741 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309642.022181:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788309642.022199:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff97c8fc934800/0x63a04852f46296fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x63a04852f4629702 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309642.022208:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8fc934800 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:0.0:1788309642.022213:0:14350:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff97c8fc934800/0x63a04852f46296fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x63a04852f4629702 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309642.022223:0:14350:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff97c8fc934800/0x63a04852f46296fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x63a04852f4629702 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788309642.022231:0:14350:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff97c8fc934800/0x63a04852f46296fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x63a04852f4629702 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788309642.022236:0:14350:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788309642.022351:0:14350:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff97c8fc934800/0x63a04852f46296fb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f4629702 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309642.022358:0:14350:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788309642.022383:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff97c8fc934800/0x63a04852f46296fb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f4629702 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309642.022390:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff97c8fc934800/0x63a04852f46296fb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f4629702 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309642.022428:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309642.022430:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309642.022432:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788309642.022466:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffbb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a1139bce-bc3d-41b1-9121-b11888b6dcf4:3302:1875178210550144:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788309642.022522:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309642.022699:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210550144 00000100:00100000:3.0:1788309642.022706:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210550144 00010000:00010000:3.0:1788309642.022734:0:14348:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c8f5549200/0x63a04852f4629702 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63a04852f46296fb expref: 12 pid: 14357 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309642.022766:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788309642.022776:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffbb1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a1139bce-bc3d-41b1-9121-b11888b6dcf4+12:3302:x1875178210550144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788309642.022790:0:14348:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788309642.022796:0:14348:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c8f5549200/0x63a04852f4629702 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63a04852f46296fb expref: 12 pid: 14357 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309642.022814:0:14348:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c8f5549200/0x63a04852f4629702 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x63a04852f46296fb expref: 12 pid: 14357 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309642.022828:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c8f5549200/0x63a04852f4629702 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x63a04852f46296fb expref: 12 pid: 14357 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309642.022842:0:14348:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97c8f5549c00/0x63a04852f4629741 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309642.022850:0:14348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8f5549c00/0x63a04852f4629741 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309642.022866:0:14348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97c8f5549c00/0x63a04852f4629741 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309642.022874:0:14348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97c8f5549c00/0x63a04852f4629741 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309642.022892:0:14348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97c8f5549c00/0x63a04852f4629741 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309642.022899:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97c8f5549c00/0x63a04852f4629741 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309642.022905:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8f5549c00 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:3.0:1788309642.022909:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97c8f5549c00/0x63a04852f4629741 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309642.022917:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97c8f5549c00/0x63a04852f4629741 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309642.022941:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97c8f5549c00/0x63a04852f4629741 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309642.022957:0:14348:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788309642.022992:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffbb1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a1139bce-bc3d-41b1-9121-b11888b6dcf4+11:3302:x1875178210550144:12345-0@lo:103:ldlm_bl.0 Request processed in 219us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309642.022999:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788309642.023028:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffbb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a1139bce-bc3d-41b1-9121-b11888b6dcf4:3302:1875178210550144:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788309642.023819:0:14793:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97c8f5549c00/0x63a04852f4629741 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309642.023833:0:14793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97c8f5549c00/0x63a04852f4629741 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309642.023840:0:14793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c8f5549c00/0x63a04852f4629741 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309642.912628:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788309643.872630:0:14360:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788309643.872639:0:14360:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97c8ffb11000 from 10 10000000:01000000:2.0:1788309643.872645:0:14360:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788309643.872723:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8fc935200/0x63a04852f4629748 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309643.872735:0:14360:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff97c8fc935200/0x63a04852f4629748 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309643.872764:0:14360:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff97c8fc935200/0x63a04852f4629748 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309643.872792:0:14360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14360:1875178210550272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788309643.872874:0:14360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309643.872964:0:14360:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d86e7f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788309643.873092:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210550272 00000100:00100000:0.0:1788309643.873103:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210550272 00000100:00100000:0.0:1788309643.873158:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788309643.873168:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f522f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1139bce-bc3d-41b1-9121-b11888b6dcf4+11:14360:x1875178210550272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788309643.873182:0:14357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788309643.873197:0:14357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c8ecf2e600/0x63a04852f462974f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x63a04852f4629748 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309643.873220:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8ecf2e600/0x63a04852f462974f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63a04852f4629748 expref: 12 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309643.873231:0:14357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c8ecf2e600/0x63a04852f462974f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f4629748 expref: 12 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309643.873252:0:14357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8ecf2e600, rc 0) 00000100:00100000:0.0:1788309643.873333:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f522f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1139bce-bc3d-41b1-9121-b11888b6dcf4+12:14360:x1875178210550272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 166us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309643.873340:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788309643.873429:0:14360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14360:1875178210550272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788309643.873444:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff97c8fc935200/0x63a04852f4629748 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f462974f expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309643.873453:0:14360:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff97c8fc935200/0x63a04852f4629748 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x63a04852f462974f expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309643.873507:0:14360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14360:1875178210550400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788309643.873533:0:14360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309643.873552:0:14360:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d86e7f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788309643.873620:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210550400 00000100:00100000:3.0:1788309643.873625:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210550400 00000100:00100000:3.0:1788309643.873660:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788309643.873668:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f522f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1139bce-bc3d-41b1-9121-b11888b6dcf4+12:14360:x1875178210550400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788309643.874134:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f522f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1139bce-bc3d-41b1-9121-b11888b6dcf4+12:14360:x1875178210550400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 465us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309643.874142:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788309643.876842:0:14360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14360:1875178210550400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788309643.877364:0:14360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14360:1875178210550528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788309643.877469:0:14360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309643.877602:0:14360:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d86e7f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788309643.886130:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210550528 00000100:00100000:1.0:1788309643.886147:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210550528 00000100:00100000:1.0:1788309643.886203:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788309643.886214:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f522c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1139bce-bc3d-41b1-9121-b11888b6dcf4+12:14360:x1875178210550528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788309643.886487:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f522c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1139bce-bc3d-41b1-9121-b11888b6dcf4+12:14360:x1875178210550528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 273us (9017us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309643.886496:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788309643.886655:0:14360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14360:1875178210550528:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788309643.901313:0:14862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788309643.903043:0:14360:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788309643.903221:0:14360:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788309643.903233:0:14360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8fc935200/0x63a04852f4629748 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f462974f expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309643.903266:0:14360:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff97c8fc935200/0x63a04852f4629748 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f462974f expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309643.944295:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788309644.768458:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788309644.768465:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788309644.768468:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788309644.768487:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788309644.768532:0:3299:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788309634/real 1788309634] req@ffff97c8fc576300 x1875178210547200/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788309644 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788309644.768557:0:3299:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff97c8fc576300 x1875178210547200/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788309644 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788309644.768568:0:3299:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788309634/real 1788309634] req@ffff97c8fc574000 x1875178210547072/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788309644 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788309644.768987:0:3299:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff97c8fc574000 x1875178210547072/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788309644 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788309644.769005:0:3299:0:(import.c:65:import_set_state_nolock()) ffff97c8d693f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788309644.769022:0:3299:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788309644.769025:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc576300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875178210547200:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788309644.769032:0:3299:0:(import.c:65:import_set_state_nolock()) ffff97c8fc746000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788309644.769037:0:3299:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788309644.769040:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc574000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875178210547072:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1788309644.769111:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a1139bce-bc3d-41b1-9121-b11888b6dcf4:3303:1875178210550656:0@lo:400:kworker.0 00000100:00100000:2.0:1788309644.769185:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309644.769251:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875178210550784:0@lo:400:kworker.0 00000100:00100000:2.0:1788309644.769304:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309644.769346:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210550656 00000100:00100000:2.0:1788309644.769354:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210550656 00000100:00100000:2.0:1788309644.769407:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788309644.769417:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffd9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1139bce-bc3d-41b1-9121-b11888b6dcf4+12:3303:x1875178210550656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309644.769475:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffd9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1139bce-bc3d-41b1-9121-b11888b6dcf4+12:3303:x1875178210550656:12345-0@lo:400:kworker.0 Request processed in 58us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309644.769483:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788309644.769515:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210550784 00000100:00100000:2.0:1788309644.769519:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210550784 00000100:00100000:2.0:1788309644.769544:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788309644.769550:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8eff0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875178210550784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309644.769727:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8eff0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875178210550784:12345-0@lo:400:kworker.0 Request processed in 175us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309644.769735:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788309644.769784:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff97c8eff0f100 x1875178210550784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309660 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788309644.769798:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875178210550784:0@lo:400:kworker.0 00000100:00080000:2.0:1788309644.769817:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788309644.769822:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788309644.769825:0:8:0:(import.c:65:import_set_state_nolock()) ffff97c8fc746000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788309644.769830:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 396 00000100:00080000:2.0:1788309644.769843:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788309644.769848:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff97c8fc746000 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:2.0:1788309644.769873:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97c8eff0f100 x1875178210550912/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788309644.769891:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788309644.769895:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788309644.769896:0:8:0:(import.c:65:import_set_state_nolock()) ffff97c8d693f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788309644.769900:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 396 00000100:00080000:2.0:1788309644.769902:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788309644.769905:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff97c8d693f800 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:2.0:1788309644.769917:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97c8eff0d880 x1875178210551040/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788309644.769950:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a1139bce-bc3d-41b1-9121-b11888b6dcf4:3303:1875178210550656:0@lo:400:kworker.0 00000100:00100000:2.0:1788309644.769969:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875178210550912:0@lo:8:kworker.0 00000400:00000100:2.0:1788309644.769995:0:3299:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875178210550912 offset 0 length 520: 4 00000100:00100000:2.0:1788309644.770009:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875178210551040:0@lo:8:kworker.0 00000400:00000100:2.0:1788309644.770025:0:3299:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875178210551040 offset 0 length 520: 4 00010000:00010000:3.0:1788309644.975792:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309645.989929:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788309646.497025:0:14394:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788309647.009532:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788309647.063329:0:15043:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788309647.063334:0:15043:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1788309647.063573:0:15043:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff97c8d0dae800 00000020:01000004:3.0:1788309647.063592:0:15043:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788309647.063604:0:15043:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788309647.063617:0:15043:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff97c8e6618000) 00000020:00000080:3.0:1788309647.063637:0:15043:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788309647.094812:0:15043:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788309647.096049:0:15043:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1788309647.097999:0:15043:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1788309647.098668:0:15043:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1788309647.098899:0:15043:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1788309647.099720:0:15043:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 479: rc = 0 00100000:10000000:0.0:1788309647.099857:0:15043:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 479: rc = 0 00100000:10000000:0.0:1788309647.102333:0:15043:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 479: rc = 0 00100000:10000000:0.0:1788309647.105530:0:15043:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 519: rc = 0 00100000:10000000:0.0:1788309647.105929:0:15043:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 519: rc = 0 00100000:10000000:0.0:1788309647.106163:0:15043:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 519: rc = 0 00100000:10000000:0.0:1788309647.113436:0:15043:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 519: rc = 0 00100000:10000000:0.0:1788309647.113765:0:15043:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 519: rc = 0 00100000:10000000:0.0:1788309647.114037:0:15043:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 519: rc = 0 00000020:00000080:0.0:1788309647.114665:0:15043:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1788309647.114679:0:15043:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788309647.114691:0:15043:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x63a04852f462975d 00000020:01000004:0.0:1788309647.114699:0:15043:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1788309647.114724:0:15043:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.155@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788309647.114728:0:15043:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.155@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788309647.114735:0:15043:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1788309647.114741:0:15043:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1788309647.114753:0:15043:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff97c8e644cd28) 00000020:00000080:0.0:1788309647.114763:0:15043:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:0.0:1788309647.115906:0:15043:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788309647.116084:0:15043:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1788309647.116091:0:15043:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1788309647.134294:0:15043:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1788309647.134309:0:15043:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788309647.134914:0:15043:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788309647.134919:0:15043:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1788309647.136774:0:15043:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788309647.137987:0:15043:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788309647.137995:0:15043:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788309647.139640:0:15043:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788309647.139654:0:15043:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788309647.166751:0:15043:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788309647.167043:0:15043:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788309647.167052:0:15043:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788309647.168758:0:15043:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788309647.168770:0:15043:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788309647.169812:0:15043:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788309647.169822:0:15043:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1788309647.172835:0:15043:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788309647.173041:0:15043:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1788309647.173055:0:15043:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1788309647.176326:0:15043:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1788309647.176344:0:15043:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788309647.226105:0:15043:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788309647.226356:0:15043:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788309647.226365:0:15043:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1788309647.229009:0:15043:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1788309647.229025:0:15043:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788309647.230262:0:15043:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788309647.230314:0:15043:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1788309647.230322:0:15043:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.155@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1788309647.246471:0:15043:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.155@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788309647.246520:0:15043:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.155@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1788309647.246525:0:15043:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788309647.246526:0:15043:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788309647.246528:0:15043:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788309647.246529:0:15043:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788309647.246530:0:15043:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788309647.246531:0:15043:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788309647.246532:0:15043:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788309647.246534:0:15043:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788309647.246535:0:15043:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788309647.246539:0:15043:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1788309647.246542:0:15043:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788309647.246543:0:15043:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788309647.246544:0:15043:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788309647.246545:0:15043:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788309647.246546:0:15043:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788309647.246739:0:15043:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788309647.246741:0:15043:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788309647.246742:0:15043:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788309647.246743:0:15043:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788309647.246776:0:15043:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788309647.246803:0:15043:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffbb3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:15043:1875178210551168:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788309647.247036:0:15043:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309647.247143:0:15043:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d69e80c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788309647.247194:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210551168 00000100:00100000:2.0:1788309647.247204:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210551168 00000100:00100000:2.0:1788309647.247518:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788309647.247529:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffd9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1139bce-bc3d-41b1-9121-b11888b6dcf4+12:15043:x1875178210551168:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788309647.247573:0:14357:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788309647.247577:0:14357:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1788309647.247581:0:14357:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788309647.255219:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffd9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1139bce-bc3d-41b1-9121-b11888b6dcf4+12:15043:x1875178210551168:12345-0@lo:253:mount.lustre.0 Request processed in 7682us (8173us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309647.255235:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788309647.256518:0:15043:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffbb3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:15043:1875178210551168:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788309647.256538:0:15043:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788309647.256542:0:15043:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788309647.256544:0:15043:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788309647.256545:0:15043:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788309647.256561:0:15043:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788309647.256562:0:15043:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788309647.256564:0:15043:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788309647.256566:0:15043:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788309647.256568:0:15043:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788309647.256569:0:15043:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788309647.256594:0:15043:0:(tgt_mount.c:101:server_register_mount()) register mount ffff97c8d0dae800 from lustre-OST0000 10000000:01000000:2.0:1788309647.256639:0:15043:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788309647.256643:0:15043:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788309647.256651:0:15043:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff97c8f4f319b8 local copy 00010000:00010000:2.0:1788309647.256664:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8c153b600/0x63a04852f4629653 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f462965a expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309647.257204:0:15043:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:15043:1875178210551296:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788309647.257258:0:15043:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309647.258060:0:15043:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8f51dbd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788309647.258156:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210551296 00000100:00100000:1.0:1788309647.258165:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210551296 00000100:00100000:1.0:1788309647.258224:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788309647.258234:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffd9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1139bce-bc3d-41b1-9121-b11888b6dcf4+12:15043:x1875178210551296:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788309647.258869:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffd9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1139bce-bc3d-41b1-9121-b11888b6dcf4+12:15043:x1875178210551296:12345-0@lo:501:mount.lustre.0 Request processed in 634us (1607us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788309647.258886:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788309647.259112:0:15043:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:15043:1875178210551296:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788309647.259132:0:15043:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.155@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788309647.259447:0:15043:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.155@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788309647.259457:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8c153b600/0x63a04852f4629653 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f462965a expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309647.259469:0:15043:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff97c8c153b600/0x63a04852f4629653 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f462965a expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788309647.259498:0:15043:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff97c8d0dae800 10000000:01000000:2.0:1788309647.259504:0:15043:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788309647.259509:0:15043:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff97c8f4f319b8 10000000:01000000:2.0:1788309647.259512:0:15043:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1788309647.259516:0:15043:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff97c8f4f319b8 from 1 10000000:01000000:2.0:1788309647.259519:0:15043:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788309647.259812:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8fc934000/0x63a04852f462976b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309647.259821:0:15043:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff97c8fc934000/0x63a04852f462976b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309647.260464:0:15043:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff97c8fc934000/0x63a04852f462976b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309647.260491:0:15043:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:15043:1875178210551424:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788309647.260708:0:15043:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309647.260750:0:15043:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8f51dbd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788309647.260815:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210551424 00000100:00100000:0.0:1788309647.260822:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210551424 00000100:00100000:0.0:1788309647.261018:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788309647.261029:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffd9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1139bce-bc3d-41b1-9121-b11888b6dcf4+12:15043:x1875178210551424:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788309647.261042:0:14357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788309647.261060:0:14357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c8ecf2e000/0x63a04852f4629772 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x63a04852f462976b expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309647.261083:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8ecf2e000/0x63a04852f4629772 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63a04852f462976b expref: 13 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309647.261092:0:14357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c8ecf2e000/0x63a04852f4629772 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f462976b expref: 13 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309647.261101:0:14357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8ecf2e000, rc 0) 00000100:00100000:0.0:1788309647.261142:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffd9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1139bce-bc3d-41b1-9121-b11888b6dcf4+13:15043:x1875178210551424:12345-0@lo:101:mount.lustre.0 Request processed in 115us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309647.261148:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788309647.261215:0:15043:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:15043:1875178210551424:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788309647.261239:0:15043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff97c8fc934000/0x63a04852f462976b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4629772 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309647.261249:0:15043:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff97c8fc934000/0x63a04852f462976b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x63a04852f4629772 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788309647.261267:0:15043:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788309647.261304:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8fc934000/0x63a04852f462976b lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4629772 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309647.261312:0:15043:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff97c8fc934000/0x63a04852f462976b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4629772 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788309647.261319:0:15043:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788309647.261323:0:15043:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788309647.261329:0:15043:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1788309647.261331:0:15043:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788309647.261350:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8fc935000/0x63a04852f4629779 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309647.261357:0:15043:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff97c8fc935000/0x63a04852f4629779 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309647.261364:0:15043:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff97c8fc935000/0x63a04852f4629779 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309647.261385:0:15043:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:15043:1875178210551552:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788309647.261410:0:15043:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309647.262051:0:15043:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8f51dbd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788309647.262128:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210551552 00000100:00100000:3.0:1788309647.262134:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210551552 00000100:00100000:3.0:1788309647.262164:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788309647.262177:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffd9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1139bce-bc3d-41b1-9121-b11888b6dcf4+13:15043:x1875178210551552:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788309647.262187:0:14355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309647.262198:0:14355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c8c153b400/0x63a04852f4629780 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x63a04852f4629779 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309647.262218:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8c153b400/0x63a04852f4629780 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63a04852f4629779 expref: 14 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309647.262227:0:14355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c8c153b400/0x63a04852f4629780 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f4629779 expref: 14 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309647.262235:0:14355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8c153b400, rc 0) 00000100:00100000:3.0:1788309647.262301:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffd9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1139bce-bc3d-41b1-9121-b11888b6dcf4+14:15043:x1875178210551552:12345-0@lo:101:mount.lustre.0 Request processed in 125us (889us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309647.262307:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788309647.262396:0:15043:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:15043:1875178210551552:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788309647.262408:0:15043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff97c8fc935000/0x63a04852f4629779 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4629780 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309647.262417:0:15043:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff97c8fc935000/0x63a04852f4629779 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x63a04852f4629780 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788309647.267159:0:15043:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1788309647.269214:0:15043:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788309647.270032:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1788309647.270086:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1788309647.270121:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1788309647.270166:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1788309647.270200:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1788309647.270234:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1788309647.270472:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1788309647.270481:0:15043:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1788309647.270669:0:15043:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc575180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:15043:1875178210551680:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788309647.270755:0:15043:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309647.270809:0:15043:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c94ad600 going to sleep for 11 seconds 00000100:00100000:2.0:1788309647.270994:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210551680 00000100:00100000:2.0:1788309647.271004:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210551680 00000100:00100000:2.0:1788309647.271064:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788309647.271074:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffd9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1139bce-bc3d-41b1-9121-b11888b6dcf4+14:15043:x1875178210551680:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788309647.271841:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffd9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1139bce-bc3d-41b1-9121-b11888b6dcf4+14:15043:x1875178210551680:12345-0@lo:501:mount.lustre.0 Request processed in 757us (1075us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309647.271858:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788309647.272644:0:15043:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc575180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:15043:1875178210551680:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788309647.272698:0:15043:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffbb2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:15043:1875178210551808:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788309647.272753:0:15043:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309647.272792:0:15043:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d69e8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788309647.272987:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210551808 00000100:00100000:1.0:1788309647.272995:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210551808 00000100:00100000:1.0:1788309647.273077:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788309647.273089:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffd9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1139bce-bc3d-41b1-9121-b11888b6dcf4+14:15043:x1875178210551808:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788309647.273508:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffd9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1139bce-bc3d-41b1-9121-b11888b6dcf4+14:15043:x1875178210551808:12345-0@lo:503:mount.lustre.0 Request processed in 421us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309647.273518:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788309647.273801:0:15043:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffbb2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:15043:1875178210551808:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788309647.274464:0:15043:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788309647.274543:0:15043:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc576d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:15043:1875178210551936:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788309647.274952:0:15043:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309647.275529:0:15043:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8db2c7300 going to sleep for 11 seconds 00000100:00100000:1.0:1788309647.275737:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210551936 00000100:00100000:1.0:1788309647.275745:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210551936 00000100:00100000:1.0:1788309647.275789:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788309647.275800:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffd9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1139bce-bc3d-41b1-9121-b11888b6dcf4+14:15043:x1875178210551936:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788309647.276115:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffd9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1139bce-bc3d-41b1-9121-b11888b6dcf4+14:15043:x1875178210551936:12345-0@lo:502:mount.lustre.0 Request processed in 316us (1161us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309647.276123:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788309647.276501:0:15043:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc576d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:15043:1875178210551936:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788309647.276820:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1788309647.277062:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1788309647.277143:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1788309647.277193:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1788309647.277247:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1788309647.277322:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1788309647.277374:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1788309647.277409:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1788309647.277441:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1788309647.277486:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1788309647.277536:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1788309647.277822:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1788309647.279490:0:15043:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc576d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:15043:1875178210552064:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788309647.279721:0:15043:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309647.279769:0:15043:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8db2c7300 going to sleep for 11 seconds 00000100:00100000:1.0:1788309647.279867:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210552064 00000100:00100000:1.0:1788309647.279876:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210552064 00000100:00100000:1.0:1788309647.280004:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788309647.280016:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffd9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1139bce-bc3d-41b1-9121-b11888b6dcf4+14:15043:x1875178210552064:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788309647.280773:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffd9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1139bce-bc3d-41b1-9121-b11888b6dcf4+14:15043:x1875178210552064:12345-0@lo:502:mount.lustre.0 Request processed in 757us (1050us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309647.280782:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788309647.280970:0:15043:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc576d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:15043:1875178210552064:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788309647.281102:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1788309647.281121:0:15043:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:1.0:1788309647.283145:0:15057:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788309647.283157:0:15057:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1788309647.283165:0:15057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788309647.283167:0:15057:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788309647.283184:0:15057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788309647.283201:0:15057:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff97c8ecf799b8) 00000020:00000080:1.0:1788309647.283223:0:15057:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788309647.283230:0:15057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788309647.283330:0:15057:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97c8d0dae800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788309647.283406:0:15057:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788309647.283416:0:15057:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x63a04852f462978e 00010000:00010000:1.0:1788309647.288098:0:15057:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:1.0:1788309647.290790:0:15057:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:1.0:1788309647.299074:0:15057:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1788309647.303712:0:15057:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788309647.303725:0:15057:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788309647.303742:0:15057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788309647.303745:0:15057:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788309647.303750:0:15057:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788309647.303753:0:15057:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:3.0:1788309647.303754:0:15057:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788309647.303756:0:15057:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788309647.303757:0:15057:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788309647.303759:0:15057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788309647.303760:0:15057:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788309647.303762:0:15057:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788309647.303765:0:15057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788309647.303766:0:15057:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788309647.303769:0:15057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788309647.303771:0:15057:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788309647.303773:0:15057:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788309647.303775:0:15057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788309647.303777:0:15057:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788309647.303779:0:15057:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788309647.303780:0:15057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788309647.303782:0:15057:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788309647.303785:0:15057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788309647.303849:0:15057:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788309647.303853:0:15057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788309647.303854:0:15057:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788309647.303857:0:15057:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1788309647.304158:0:15043:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1788309647.304192:0:15043:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788309647.304217:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8fc935000/0x63a04852f4629779 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4629780 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309647.304230:0:15043:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff97c8fc935000/0x63a04852f4629779 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4629780 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788309647.304238:0:15043:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97c8d0dae800 from 1 10000000:01000000:1.0:1788309647.304241:0:15043:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788309647.304295:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8f5548400/0x63a04852f4629795 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309647.304304:0:15043:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff97c8f5548400/0x63a04852f4629795 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309647.304316:0:15043:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff97c8f5548400/0x63a04852f4629795 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309647.304339:0:15043:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecb42680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:15043:1875178210552192:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788309647.304790:0:15043:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309647.304855:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210552192 00000100:00100000:1.0:1788309647.304862:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210552192 00000100:00100000:1.0:1788309647.305033:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788309647.305044:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffd9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1139bce-bc3d-41b1-9121-b11888b6dcf4+14:15043:x1875178210552192:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788309647.305058:0:14356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788309647.305074:0:14356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c8f5548000/0x63a04852f462979c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x63a04852f4629795 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309647.305100:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8f5548000/0x63a04852f462979c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63a04852f4629795 expref: 15 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309647.305112:0:14356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c8f5548000/0x63a04852f462979c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f4629795 expref: 15 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309647.305121:0:14356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8f5548000, rc 0) 00000100:00100000:1.0:1788309647.305167:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffd9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1139bce-bc3d-41b1-9121-b11888b6dcf4+15:15043:x1875178210552192:12345-0@lo:101:mount.lustre.0 Request processed in 124us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309647.305174:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788309647.305216:0:15043:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d6aec000 going to sleep for 11 seconds 00000100:00100000:1.0:1788309647.305238:0:15043:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecb42680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:15043:1875178210552192:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788309647.305254:0:15043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff97c8f5548400/0x63a04852f4629795 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f462979c expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309647.305264:0:15043:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff97c8f5548400/0x63a04852f4629795 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x63a04852f462979c expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788309647.308005:0:15043:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1788309647.313166:0:15043:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788309647.313595:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1788309647.313665:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1788309647.313730:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1788309647.313738:0:15043:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1788309647.313832:0:15043:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecb42680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:15043:1875178210552320:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788309647.313903:0:15043:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309647.313945:0:15043:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d6aec000 going to sleep for 11 seconds 00000100:00100000:3.0:1788309647.314623:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210552320 00000100:00100000:3.0:1788309647.314632:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210552320 00000100:00100000:3.0:1788309647.314705:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788309647.314718:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ee48f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1139bce-bc3d-41b1-9121-b11888b6dcf4+15:15043:x1875178210552320:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788309647.315039:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ee48f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1139bce-bc3d-41b1-9121-b11888b6dcf4+15:15043:x1875178210552320:12345-0@lo:501:mount.lustre.0 Request processed in 323us (1134us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309647.315048:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788309647.320252:0:15043:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecb42680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:15043:1875178210552320:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788309647.321043:0:15043:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecb42680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:15043:1875178210552448:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788309647.322536:0:15043:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309647.323342:0:15043:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d6aec000 going to sleep for 11 seconds 00000100:00100000:2.0:1788309647.327864:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210552448 00000100:00100000:2.0:1788309647.327879:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210552448 00000100:00100000:3.0:1788309647.328084:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788309647.328119:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ee48d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1139bce-bc3d-41b1-9121-b11888b6dcf4+15:15043:x1875178210552448:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788309647.331119:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ee48d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1139bce-bc3d-41b1-9121-b11888b6dcf4+15:15043:x1875178210552448:12345-0@lo:503:mount.lustre.0 Request processed in 2996us (8580us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309647.331133:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788309647.331249:0:15043:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecb42680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:15043:1875178210552448:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788309647.332324:0:15043:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788309647.332412:0:15043:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecb42680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:15043:1875178210552576:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788309647.332471:0:15043:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309647.332520:0:15043:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d6aec000 going to sleep for 11 seconds 00000100:00100000:2.0:1788309647.332996:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210552576 00000100:00100000:2.0:1788309647.333004:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210552576 00000100:00100000:2.0:1788309647.333051:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788309647.333060:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ee48ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1139bce-bc3d-41b1-9121-b11888b6dcf4+15:15043:x1875178210552576:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788309647.333243:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ee48ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1139bce-bc3d-41b1-9121-b11888b6dcf4+15:15043:x1875178210552576:12345-0@lo:502:mount.lustre.0 Request processed in 183us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309647.333250:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788309647.333737:0:15043:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecb42680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:15043:1875178210552576:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788309647.334306:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788309647.334363:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1788309647.334408:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1788309647.334440:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1788309647.334466:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1788309647.334524:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1788309647.336059:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1788309647.336115:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1788309647.336167:0:15043:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc576d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:15043:1875178210552704:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788309647.336250:0:15043:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309647.336306:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210552704 00000100:00100000:3.0:1788309647.336312:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210552704 00000100:00100000:3.0:1788309647.336374:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788309647.336384:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ee48d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1139bce-bc3d-41b1-9121-b11888b6dcf4+15:15043:x1875178210552704:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788309647.336584:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ee48d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1139bce-bc3d-41b1-9121-b11888b6dcf4+15:15043:x1875178210552704:12345-0@lo:502:mount.lustre.0 Request processed in 200us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309647.336593:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788309647.336656:0:15043:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8db2c70c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788309647.336678:0:15043:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc576d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:15043:1875178210552704:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788309647.336799:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1788309647.336809:0:15043:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1788309647.338419:0:15062:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788309647.338431:0:15062:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788309647.338434:0:15062:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788309647.338440:0:15062:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97c8d0dae800 00000020:00000080:2.0:1788309647.338442:0:15062:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788309647.338451:0:15062:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788309647.338453:0:15062:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788309647.338454:0:15062:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788309647.338456:0:15062:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788309647.338464:0:15062:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788309647.338465:0:15062:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788309647.338469:0:15062:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97c8d0dae800 00000020:00000080:2.0:1788309647.338471:0:15062:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788309647.338535:0:15062:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788309647.338539:0:15062:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788309647.338540:0:15062:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788309647.338542:0:15062:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788309647.338545:0:15062:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788309647.338568:0:15062:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788309647.338573:0:15062:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff97c8d0dae800 00000020:00000080:2.0:1788309647.338575:0:15062:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788309647.338614:0:15062:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788309647.338618:0:15062:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788309647.338620:0:15062:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788309647.338623:0:15062:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1788309647.338684:0:15043:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788309647.338711:0:15043:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788309647.338730:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8f5548400/0x63a04852f4629795 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f462979c expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309647.338743:0:15043:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff97c8f5548400/0x63a04852f4629795 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f462979c expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788309647.338787:0:15043:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788309647.338790:0:15043:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff97c8d0dae800 10000000:01000000:2.0:1788309647.338793:0:15043:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff97c8d0dae800 10000000:01000000:2.0:1788309647.338797:0:15043:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788309647.338802:0:15043:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97c8d0dae800 from 1 10000000:01000000:2.0:1788309647.338805:0:15043:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788309647.338839:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8fc934600/0x63a04852f46297a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309647.338858:0:15043:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff97c8fc934600/0x63a04852f46297a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309647.338871:0:15043:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff97c8fc934600/0x63a04852f46297a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309647.338895:0:15043:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:15043:1875178210552832:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788309647.338960:0:15043:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309647.339008:0:15043:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8f51db300 going to sleep for 11 seconds 00000100:00100000:1.0:1788309647.339130:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210552832 00000100:00100000:1.0:1788309647.339138:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210552832 00000100:00100000:1.0:1788309647.339193:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788309647.339205:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ee48f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1139bce-bc3d-41b1-9121-b11888b6dcf4+15:15043:x1875178210552832:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788309647.339219:0:14356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788309647.339233:0:14356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c8f5549600/0x63a04852f46297aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x63a04852f46297a3 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309647.339257:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8f5549600/0x63a04852f46297aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63a04852f46297a3 expref: 16 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309647.339267:0:14356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c8f5549600/0x63a04852f46297aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f46297a3 expref: 16 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309647.339303:0:14356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8f5549600, rc 0) 00000100:00100000:1.0:1788309647.339340:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ee48f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1139bce-bc3d-41b1-9121-b11888b6dcf4+16:15043:x1875178210552832:12345-0@lo:101:mount.lustre.0 Request processed in 137us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309647.339347:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788309647.341767:0:15043:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:15043:1875178210552832:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788309647.341794:0:15043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff97c8fc934600/0x63a04852f46297a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f46297aa expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309647.341807:0:15043:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff97c8fc934600/0x63a04852f46297a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x63a04852f46297aa expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788309647.342371:0:15043:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1788309647.342812:0:15043:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788309647.343071:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788309647.343118:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1788309647.343149:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1788309647.343191:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1788309647.343222:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1788309647.343266:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1788309647.343333:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1788309647.346598:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1788309647.346776:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1788309647.346817:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1788309647.346860:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1788309647.346906:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1788309647.346943:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1788309647.346977:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1788309647.347027:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1788309647.347079:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1788309647.347114:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1788309647.347164:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1788309647.347197:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1788309647.347229:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1788309647.347273:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1788309647.347330:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1788309647.347361:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1788309647.351269:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1788309647.351336:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1788309647.351937:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1788309647.352005:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1788309647.352041:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1788309647.352127:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1788309647.352134:0:15043:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1788309647.352243:0:15043:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:15043:1875178210552960:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788309647.352336:0:15043:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309647.353170:0:15043:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8f51db300 going to sleep for 11 seconds 00000100:00100000:3.0:1788309647.357513:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210552960 00000100:00100000:3.0:1788309647.357536:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210552960 00000100:00100000:3.0:1788309647.357614:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788309647.357625:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ee53b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1139bce-bc3d-41b1-9121-b11888b6dcf4+16:15043:x1875178210552960:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788309647.357921:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ee53b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1139bce-bc3d-41b1-9121-b11888b6dcf4+16:15043:x1875178210552960:12345-0@lo:501:mount.lustre.0 Request processed in 297us (5585us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309647.357930:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788309647.358006:0:15043:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:15043:1875178210552960:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788309647.358057:0:15043:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc576d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:15043:1875178210553088:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788309647.358100:0:15043:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309647.358138:0:15043:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c9311e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788309647.358292:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210553088 00000100:00100000:0.0:1788309647.358297:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210553088 00000100:00100000:0.0:1788309647.358322:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788309647.358723:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ee538c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1139bce-bc3d-41b1-9121-b11888b6dcf4+16:15043:x1875178210553088:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788309647.359425:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ee538c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1139bce-bc3d-41b1-9121-b11888b6dcf4+16:15043:x1875178210553088:12345-0@lo:503:mount.lustre.0 Request processed in 1095us (1322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309647.359523:0:15043:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc576d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:15043:1875178210553088:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788309647.362813:0:15043:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788309647.362906:0:15043:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc576d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:15043:1875178210553216:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788309647.362934:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788309647.362984:0:15043:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309647.363027:0:15043:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c9311e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788309647.363503:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210553216 00000100:00100000:1.0:1788309647.363511:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210553216 00000100:00100000:1.0:1788309647.363573:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788309647.363585:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ee538050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1139bce-bc3d-41b1-9121-b11888b6dcf4+16:15043:x1875178210553216:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788309647.363819:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ee538050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1139bce-bc3d-41b1-9121-b11888b6dcf4+16:15043:x1875178210553216:12345-0@lo:502:mount.lustre.0 Request processed in 237us (834us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309647.363826:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788309647.369757:0:15043:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc576d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:15043:1875178210553216:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788309647.370091:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788309647.370148:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1788309647.370184:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1788309647.370233:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1788309647.370272:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1788309647.370349:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1788309647.370388:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1788309647.370423:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1788309647.370472:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788309647.370508:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1788309647.370540:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1788309647.373969:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1788309647.374011:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1788309647.374063:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1788309647.374114:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1788309647.374147:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1788309647.374182:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1788309647.374250:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1788309647.374321:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1788309647.374357:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1788309647.374407:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1788309647.374445:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1788309647.374479:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1788309647.374537:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1788309647.376847:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1788309647.376897:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1788309647.376963:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1788309647.376997:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1788309647.377028:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1788309647.377098:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1788309647.377130:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1788309647.377158:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1788309647.377188:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1788309647.377230:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1788309647.377264:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1788309647.377332:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1788309647.377367:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1788309647.377401:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1788309647.377446:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1788309647.377482:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1788309647.377534:0:15043:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc576d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:15043:1875178210553344:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788309647.382710:0:15043:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309647.382764:0:15043:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c9311e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788309647.383323:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210553344 00000100:00100000:1.0:1788309647.383334:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210553344 00000100:00100000:1.0:1788309647.383459:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788309647.383470:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ee539850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1139bce-bc3d-41b1-9121-b11888b6dcf4+16:15043:x1875178210553344:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788309647.383760:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ee539850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1139bce-bc3d-41b1-9121-b11888b6dcf4+16:15043:x1875178210553344:12345-0@lo:502:mount.lustre.0 Request processed in 290us (1057us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309647.383768:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788309647.383775:0:15043:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc576d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:15043:1875178210553344:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788309647.383895:0:15043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1788309647.383913:0:15043:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1788309647.386538:0:15066:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788309647.386567:0:15066:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff97c8d6bd19b8) 00000020:00000080:2.0:1788309647.386589:0:15066:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1788309647.386679:0:15066:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97c8d0dae800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788309647.386683:0:15066:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97c8d0dae800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788309647.386686:0:15066:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97c8d0dae800 3 00010000:00080000:2.0:1788309647.386716:0:15066:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97c8d8543000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.155@tcp at head 00010000:00010000:2.0:1788309647.388316:0:15066:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:2.0:1788309647.392837:0:15066:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788309647.392877:0:15066:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788309647.392889:0:15066:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x63a04852f46297b8 00000100:00080000:2.0:1788309647.394163:0:15066:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788309647.394174:0:15066:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff97c8d8543000 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:2.0:1788309647.394217:0:15066:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97c8eff0ed80 x1875178210553472/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788309647.394264:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3299:1875178210553472:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788309647.394349:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309647.395463:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210553472 00000100:00100000:3.0:1788309647.395474:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210553472 00000100:00100000:3.0:1788309647.395512:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788309647.395521:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8eff0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3299:x1875178210553472:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788309647.395572:0:14363:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 410 last 0 00000020:00000080:3.0:1788309647.395614:0:14363:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x63a04852f46297bf 00000004:00100000:3.0:1788309647.395631:0:14363:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788309647.395662:0:14363:0:(import.c:65:import_set_state_nolock()) ffff97c8eff02800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788309647.401415:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8eff0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1875178210553472:12345-0@lo:38:llog_process_th.0 Request processed in 5885us (7055us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309647.401433:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1788309647.401510:0:15066:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788309647.401542:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788309647.401567:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788309647.401570:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788309647.401573:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788309647.401641:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc576d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875178210553600:0@lo:400:kworker.0 00000100:00100000:3.0:1788309647.401682:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309647.401752:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210553600 00000100:00100000:3.0:1788309647.401760:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210553600 00000100:00100000:3.0:1788309647.401798:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788309647.401807:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc575500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875178210553600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309647.401869:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc575500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875178210553600:12345-0@lo:400:kworker.0 Request processed in 63us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309647.401876:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788309647.401911:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff97c8fc576d80 x1875178210553600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309663 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788309647.401924:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc576d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875178210553600:0@lo:400:kworker.0 00000040:00080000:3.0:1788309647.403502:0:15066:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1788309647.406753:0:15043:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788309647.406794:0:15043:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788309647.406812:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8fc934600/0x63a04852f46297a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f46297aa expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309647.406825:0:15043:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff97c8fc934600/0x63a04852f46297a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f46297aa expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788309647.406889:0:15043:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788309647.406892:0:15043:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788309647.406893:0:15043:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788309647.406894:0:15043:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788309647.406896:0:15043:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788309647.406897:0:15043:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788309647.406910:0:15043:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788309647.406912:0:15043:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788309647.406914:0:15043:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788309647.406918:0:15043:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1788309647.406920:0:15043:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788309647.406921:0:15043:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788309647.406922:0:15043:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788309647.406924:0:15043:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788309647.406925:0:15043:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788309647.406931:0:15043:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788309647.406932:0:15043:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788309647.406933:0:15043:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788309647.406934:0:15043:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788309647.406961:0:15043:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788309647.406982:0:15043:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:15043:1875178210553728:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788309647.407065:0:15043:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309647.407107:0:15043:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8ecdc69c0 going to sleep for 11 seconds 00010000:00080000:2.0:1788309647.407223:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff97c8eff0ed80 x1875178210553472/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788309657 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788309647.407233:0:3299:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788309647.407242:0:3299:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1788309647.407249:0:3299:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788309647.407255:0:3299:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788309647.407258:0:3299:0:(import.c:65:import_set_state_nolock()) ffff97c8d8543000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788309647.407264:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3299:1875178210553472:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788309647.411715:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210553728 00000100:00100000:3.0:1788309647.411732:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210553728 00000100:00100000:3.0:1788309647.411790:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788309647.411801:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ee53bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1139bce-bc3d-41b1-9121-b11888b6dcf4+16:15043:x1875178210553728:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788309647.411833:0:14357:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788309647.411848:0:14357:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788309647.477057:0:14357:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788309647.477116:0:14357:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788309647.477393:0:14378:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788309647.477399:0:14378:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788309647.477422:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97c8ecf2f200/0x63a04852f46297c6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309647.477442:0:14378:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c8ecf2e400/0x63a04852f4629733 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f462972c expref: 16 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309647.477450:0:14378:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97c8ecf2f200/0x63a04852f46297c6 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309647.477492:0:14378:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c8ecf2e400/0x63a04852f4629733 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x63a04852f462972c expref: 16 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309647.477507:0:14378:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97c8ecf2e400/0x63a04852f4629733 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x63a04852f462972c expref: 16 pid: 14355 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309647.477522:0:14378:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffbb1c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14378:1875178210553856:0@lo:104: 00000100:00100000:0.0:1788309647.477859:0:14378:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309647.477990:0:14378:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d6a5bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788309647.479308:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210553856 00000100:00100000:1.0:1788309647.479323:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210553856 00000100:00100000:1.0:1788309647.479374:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788309647.479386:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffbb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a1139bce-bc3d-41b1-9121-b11888b6dcf4+3:14378:x1875178210553856:12345-0@lo:104: 00010000:00010000:1.0:1788309647.479404:0:14346:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff97c8c153a200/0x63a04852f462972c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x63a04852f4629733 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309647.479972:0:14346:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788309647.479980:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffbb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a1139bce-bc3d-41b1-9121-b11888b6dcf4+3:14378:x1875178210553856:12345-0@lo:104: Request processed in 595us (2121us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309647.479989:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788309647.480041:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788309647.480049:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff97c8c153a200/0x63a04852f462972c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x63a04852f4629733 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309647.480056:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8c153a200 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:0.0:1788309647.480061:0:14350:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff97c8c153a200/0x63a04852f462972c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x63a04852f4629733 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309647.480070:0:14350:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff97c8c153a200/0x63a04852f462972c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x63a04852f4629733 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788309647.480084:0:14350:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff97c8c153a200/0x63a04852f462972c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x63a04852f4629733 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788309647.480090:0:14350:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:2.0:1788309647.480625:0:14378:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffbb1c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14378:1875178210553856:0@lo:104: 00010000:00010000:2.0:1788309647.480653:0:14378:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97c8ecf2f200/0x63a04852f46297c6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309647.481868:0:14350:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff97c8c153a200/0x63a04852f462972c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f4629733 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309647.481880:0:14350:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788309647.481901:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff97c8c153a200/0x63a04852f462972c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f4629733 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309647.481914:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff97c8c153a200/0x63a04852f462972c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f4629733 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309647.481936:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309647.481938:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309647.481940:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788309647.482061:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffbb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a1139bce-bc3d-41b1-9121-b11888b6dcf4:3302:1875178210553984:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788309647.482139:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309647.482261:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210553984 00000100:00100000:3.0:1788309647.482272:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210553984 00010000:00010000:3.0:1788309647.482332:0:14349:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c8ecf2e400/0x63a04852f4629733 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63a04852f462972c expref: 17 pid: 14355 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309647.482363:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788309647.482372:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8eff0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1139bce-bc3d-41b1-9121-b11888b6dcf4+17:3302:x1875178210553984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788309647.482385:0:14349:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788309647.482391:0:14349:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c8ecf2e400/0x63a04852f4629733 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63a04852f462972c expref: 17 pid: 14355 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309647.482401:0:14349:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c8ecf2e400/0x63a04852f4629733 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x63a04852f462972c expref: 17 pid: 14355 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309647.482415:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c8ecf2e400/0x63a04852f4629733 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x63a04852f462972c expref: 17 pid: 14355 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309647.482440:0:14349:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97c8ecf2f200/0x63a04852f46297c6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309647.482449:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8ecf2f200/0x63a04852f46297c6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788309647.482463:0:14349:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008301366s 00010000:00010000:3.0:1788309647.482467:0:14349:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97c8ecf2f200/0x63a04852f46297c6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309647.482474:0:14349:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97c8ecf2f200/0x63a04852f46297c6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309647.482480:0:14349:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97c8ecf2f200/0x63a04852f46297c6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309647.482486:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97c8ecf2f200/0x63a04852f46297c6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309647.482491:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8ecf2f200 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:3.0:1788309647.482495:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97c8ecf2f200/0x63a04852f46297c6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309647.482501:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97c8ecf2f200/0x63a04852f46297c6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309647.482518:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97c8ecf2f200/0x63a04852f46297c6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309647.482528:0:14349:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788309647.482695:0:14378:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97c8ecf2f200/0x63a04852f46297c6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309647.482703:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97c8ecf2f200/0x63a04852f46297c6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309647.482710:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c8ecf2f200/0x63a04852f46297c6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309647.482787:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8eff0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1139bce-bc3d-41b1-9121-b11888b6dcf4+16:3302:x1875178210553984:12345-0@lo:103:ldlm_bl.0 Request processed in 415us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309647.482795:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788309647.482864:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffbb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a1139bce-bc3d-41b1-9121-b11888b6dcf4:3302:1875178210553984:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788309647.491685:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ee53bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1139bce-bc3d-41b1-9121-b11888b6dcf4+15:15043:x1875178210553728:12345-0@lo:253:mount.lustre.0 Request processed in 79876us (84611us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309647.491700:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788309647.492098:0:15043:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:15043:1875178210553728:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788309647.492117:0:15043:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788309647.492120:0:15043:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788309647.492122:0:15043:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788309647.492124:0:15043:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788309647.492125:0:15043:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788309647.492136:0:15043:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788309647.492138:0:15043:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788309647.492139:0:15043:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788309647.492142:0:15043:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788309647.492143:0:15043:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788309647.492164:0:15043:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788309647.506500:0:15043:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788309647.506683:0:15043:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788309647.506933:0:15043:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788309647.507096:0:15043:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788309647.507397:0:15043:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788309647.507633:0:15043:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788309647.513264:0:15043:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1788309647.596337:0:15043:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788309647.596347:0:15043:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788309647.596377:0:15043:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788309647.596440:0:15043:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.155@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788309647.596453:0:15043:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788309647.596479:0:15043:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1788309648.034091:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788309648.740260:0:14360:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788309648.740268:0:14360:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff97c8ffb11000 from 7 10000000:01000000:0.0:1788309648.740299:0:14360:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788309648.740347:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8ecf2ea00/0x63a04852f46297cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309648.740359:0:14360:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff97c8ecf2ea00/0x63a04852f46297cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309648.740371:0:14360:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff97c8ecf2ea00/0x63a04852f46297cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309648.740400:0:14360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffbb2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14360:1875178210554112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788309648.740478:0:14360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309648.740545:0:14360:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c8967300 going to sleep for 11 seconds 00000100:00100000:2.0:1788309648.741806:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210554112 00000100:00100000:2.0:1788309648.741817:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210554112 00000100:00100000:2.0:1788309648.741869:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788309648.741879:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ee53a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1139bce-bc3d-41b1-9121-b11888b6dcf4+15:14360:x1875178210554112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788309648.741895:0:14355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309648.741912:0:14355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c8fc935800/0x63a04852f46297d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x63a04852f46297cd expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309648.741941:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8fc935800/0x63a04852f46297d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63a04852f46297cd expref: 16 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309648.741952:0:14355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c8fc935800/0x63a04852f46297d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f46297cd expref: 16 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309648.741962:0:14355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8fc935800, rc 0) 00000100:00100000:2.0:1788309648.742033:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ee53a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1139bce-bc3d-41b1-9121-b11888b6dcf4+16:14360:x1875178210554112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (1555us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309648.742041:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788309648.742054:0:14360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffbb2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14360:1875178210554112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788309648.742076:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff97c8ecf2ea00/0x63a04852f46297cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f46297d4 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309648.742087:0:14360:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff97c8ecf2ea00/0x63a04852f46297cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x63a04852f46297d4 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309648.742168:0:14360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc576d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14360:1875178210554240:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788309648.742210:0:14360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309648.742261:0:14360:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c97cb540 going to sleep for 11 seconds 00000100:00100000:2.0:1788309648.744633:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210554240 00000100:00100000:2.0:1788309648.744645:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210554240 00000100:00100000:2.0:1788309648.744703:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788309648.744712:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ee538450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1139bce-bc3d-41b1-9121-b11888b6dcf4+16:14360:x1875178210554240:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788309648.744733:0:14357:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788309648.744754:0:14357:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788309648.744761:0:14357:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1788309648.744881:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ee538450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1139bce-bc3d-41b1-9121-b11888b6dcf4+16:14360:x1875178210554240:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 170us (2671us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309648.744889:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788309648.744914:0:14360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc576d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14360:1875178210554240:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788309648.744988:0:14360:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788309648.745003:0:14360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8ecf2ea00/0x63a04852f46297cd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f46297d4 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309648.745013:0:14360:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff97c8ecf2ea00/0x63a04852f46297cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f46297d4 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309649.056663:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309650.087110:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309651.113325:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309652.136568:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788309652.448626:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc576d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a1139bce-bc3d-41b1-9121-b11888b6dcf4:3303:1875178210554368:0@lo:400:kworker.0 00000100:00100000:0.0:1788309652.448782:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788309652.449147:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788309652.449152:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788309652.449155:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788309652.449158:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788309652.449204:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc577b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875178210554496:0@lo:400:kworker.0 00000100:00100000:3.0:1788309652.449238:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309652.449272:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788309652.449296:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc574700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875178210554624:0@lo:400:kworker.0 00000100:00100000:3.0:1788309652.449322:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309652.449323:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210554496 00000100:00100000:2.0:1788309652.449331:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210554496 00000100:00100000:3.0:1788309652.449350:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210554624 00000100:00100000:3.0:1788309652.449353:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210554624 00000100:00100000:2.0:1788309652.449377:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788309652.449386:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc576a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875178210554496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309652.449388:0:14364:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788309652.449395:0:14364:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1788309652.449409:0:14363:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788309652.449415:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788309652.449422:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc577800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875178210554624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309652.449452:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc577800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875178210554624:12345-0@lo:400:kworker.0 Request processed in 30us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309652.449452:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc576a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875178210554496:12345-0@lo:400:kworker.0 Request processed in 66us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309652.449458:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788309652.449514:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210554368 00000100:00100000:0.0:1788309652.449519:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210554368 00000100:00100000:0.0:1788309652.449552:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788309652.449558:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ee538850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1139bce-bc3d-41b1-9121-b11888b6dcf4+16:3303:x1875178210554368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309652.449591:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ee538850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1139bce-bc3d-41b1-9121-b11888b6dcf4+16:3303:x1875178210554368:12345-0@lo:400:kworker.0 Request processed in 34us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309652.449597:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788309652.449645:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc576d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a1139bce-bc3d-41b1-9121-b11888b6dcf4:3303:1875178210554368:0@lo:400:kworker.0 00010000:00080000:3.0:1788309652.454922:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97c8fc574700 x1875178210554624/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309668 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788309652.454942:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc574700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875178210554624:0@lo:400:kworker.0 00010000:00080000:3.0:1788309652.454959:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97c8fc577b80 x1875178210554496/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309668 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788309652.454969:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc577b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875178210554496:0@lo:400:kworker.0 00000100:00080000:3.0:1788309652.455176:0:14358:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788309652.457480:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788309653.154665:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788309653.715032:0:15411:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg255-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788309654.176882:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309655.205755:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309656.225009:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788309656.741530:0:14394:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788309657.253300:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788309657.578474:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788309657.578483:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788309657.578486:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788309657.578489:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788309657.578559:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffbb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875178210554880:0@lo:400:kworker.0 00000100:00100000:0.0:1788309657.578648:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309657.578712:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788309657.578718:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffbb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a1139bce-bc3d-41b1-9121-b11888b6dcf4:3303:1875178210554752:0@lo:400:kworker.0 00000100:00100000:0.0:1788309657.578754:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309657.579448:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffbb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875178210555008:0@lo:400:kworker.0 00000100:00100000:3.0:1788309657.579503:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309657.579561:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210554880 00000100:00100000:3.0:1788309657.579570:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210554880 00000100:00100000:3.0:1788309657.579622:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210555008 00000100:00100000:3.0:1788309657.579625:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210555008 00000100:00100000:3.0:1788309657.579658:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788309657.579668:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffbb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875178210554880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309657.579728:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffbb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875178210554880:12345-0@lo:400:kworker.0 Request processed in 61us (1079us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309657.579736:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788309657.579755:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788309657.579761:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc577b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875178210555008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309657.579792:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc577b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875178210555008:12345-0@lo:400:kworker.0 Request processed in 31us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309657.579799:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1788309657.580175:0:14358:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788309657.580224:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97c8ffbb0700 x1875178210555008/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309673 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788309657.580241:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffbb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875178210555008:0@lo:400:kworker.0 00010000:00080000:3.0:1788309657.580381:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97c8ffbb0000 x1875178210554880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309673 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788309657.580392:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffbb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875178210554880:0@lo:400:kworker.0 00000100:00100000:2.0:1788309657.585629:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210554752 00000100:00100000:2.0:1788309657.585649:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210554752 00000100:00100000:2.0:1788309657.587624:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788309657.587649:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ee53b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1139bce-bc3d-41b1-9121-b11888b6dcf4+16:3303:x1875178210554752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309657.587782:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ee53b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1139bce-bc3d-41b1-9121-b11888b6dcf4+16:3303:x1875178210554752:12345-0@lo:400:kworker.0 Request processed in 143us (9025us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309657.587790:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788309657.588393:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffbb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a1139bce-bc3d-41b1-9121-b11888b6dcf4:3303:1875178210554752:0@lo:400:kworker.0 00010000:00010000:1.0:1788309658.272868:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309659.297227:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788309659.682924:0:3299:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788309644/real 1788309644] req@ffff97c8eff0f100 x1875178210550912/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788309659 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788309659.682958:0:3299:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff97c8eff0f100 x1875178210550912/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788309659 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788309659.682968:0:3299:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788309644/real 1788309644] req@ffff97c8eff0d880 x1875178210551040/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788309659 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788309659.682981:0:3299:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff97c8eff0d880 x1875178210551040/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788309659 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788309659.683002:0:3299:0:(import.c:65:import_set_state_nolock()) ffff97c8fc746000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788309659.683023:0:3299:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788309659.683036:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875178210550912:0@lo:8:kworker.0 00000100:00080000:3.0:1788309659.683042:0:3299:0:(import.c:65:import_set_state_nolock()) ffff97c8d693f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788309659.683048:0:3299:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788309659.683051:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875178210551040:0@lo:8:kworker.0 00000100:00080000:2.0:1788309659.683486:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788309659.683491:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788309659.683494:0:38:0:(import.c:65:import_set_state_nolock()) ffff97c8fc746000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788309659.683499:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 407 00000100:00080000:2.0:1788309659.683504:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788309659.683510:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff97c8fc746000 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:2.0:1788309659.683538:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97c8eff0dc00 x1875178210555264/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788309659.683551:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788309659.683554:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788309659.683556:0:38:0:(import.c:65:import_set_state_nolock()) ffff97c8d693f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788309659.683559:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 407 00000100:00080000:2.0:1788309659.683561:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788309659.683565:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff97c8d693f800 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:2.0:1788309659.683575:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97c8eff0c380 x1875178210555392/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788309659.683654:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788309659.683668:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a1139bce-bc3d-41b1-9121-b11888b6dcf4:3300:1875178210555136:0@lo:400:kworker.0 00000100:00100000:1.0:1788309659.683734:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309659.683801:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875178210555648:0@lo:400:kworker.0 00000100:00100000:3.0:1788309659.684397:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875178210555520:0@lo:400:kworker.0 00000100:00100000:3.0:1788309659.684430:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309659.684488:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210555520 00000100:00100000:3.0:1788309659.684495:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210555520 00000100:00100000:3.0:1788309659.684535:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788309659.684543:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc574700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875178210555520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309659.684588:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc574700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875178210555520:12345-0@lo:400:kworker.0 Request processed in 46us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309659.684595:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788309659.684629:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97c8eff0e300 x1875178210555520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309675 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788309659.684641:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875178210555520:0@lo:400:kworker.0 00000100:00100000:3.0:1788309659.684664:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875178210555264:0@lo:8:kworker.0 00000100:00100000:3.0:1788309659.684689:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309659.684709:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875178210555392:0@lo:8:kworker.0 00000100:00100000:3.0:1788309659.684728:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309659.684803:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309659.684962:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210555136 00000100:00100000:2.0:1788309659.684967:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210555136 00000100:00100000:2.0:1788309659.684993:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788309659.685000:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ee53b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1139bce-bc3d-41b1-9121-b11888b6dcf4+16:3300:x1875178210555136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309659.685038:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ee53b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1139bce-bc3d-41b1-9121-b11888b6dcf4+16:3300:x1875178210555136:12345-0@lo:400:kworker.0 Request processed in 40us (1305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309659.685045:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788309659.685082:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a1139bce-bc3d-41b1-9121-b11888b6dcf4:3300:1875178210555136:0@lo:400:kworker.0 00000100:00100000:1.0:1788309659.685144:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210555264 00000100:00100000:1.0:1788309659.685148:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210555264 00000100:00100000:1.0:1788309659.685168:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210555392 00000100:00100000:1.0:1788309659.685170:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210555392 00000100:00100000:1.0:1788309659.685179:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788309659.685184:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc574380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3299:x1875178210555264:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788309659.685205:0:15046:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 422 last 0 00000020:00000080:1.0:1788309659.685231:0:15046:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x63a04852f46297db 00002000:00100000:1.0:1788309659.685244:0:15046:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff97c8f5555800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211392d ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788309659.685248:0:15046:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788309659.685251:0:15046:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1788309659.686931:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210555648 00000100:00100000:3.0:1788309659.686943:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210555648 00000100:00100000:3.0:1788309659.687010:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788309659.687019:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecb43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875178210555648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309659.687112:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecb43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875178210555648:12345-0@lo:400:kworker.0 Request processed in 94us (2308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309659.687119:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788309659.687165:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97c8eff0e680 x1875178210555648/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309675 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788309659.687180:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875178210555648:0@lo:400:kworker.0 00000100:00080000:2.0:1788309659.687475:0:14358:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00002000:00080000:1.0:1788309659.687735:0:15046:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788309659.687778:0:15046:0:(import.c:65:import_set_state_nolock()) ffff97c8f5557000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788309659.688930:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc574380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3299:x1875178210555264:12345-0@lo:8:kworker.0 Request processed in 3738us (4233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309659.688942:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788309659.688965:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788309659.688971:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc576680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3299:x1875178210555392:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788309659.688988:0:15046:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788309659.689495:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc576680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3299:x1875178210555392:12345-0@lo:8:kworker.0 Request processed in 522us (4764us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788309659.689503:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788309659.689608:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97c8eff0dc00 x1875178210555264/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788309679 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788309659.689626:0:3299:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788309659.689635:0:3299:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788309659.689644:0:3299:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788309659.689649:0:3299:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788309659.689653:0:3299:0:(import.c:65:import_set_state_nolock()) ffff97c8fc746000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788309659.689680:0:3299:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788309659.689687:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875178210555264:0@lo:8:kworker.0 00000100:00080000:3.0:1788309659.689701:0:3299:0:(import.c:65:import_set_state_nolock()) ffff97c8d693f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788309659.689706:0:3299:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788309659.689709:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875178210555392:0@lo:8:kworker.0 00000004:00080000:0.0:1788309659.689894:0:14384:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788309659.690157:0:14385:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:1.0:1788309659.690178:0:14385:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecb42a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14385:1875178210555904:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788309659.690223:0:14385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309659.690246:0:14385:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8e684ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1788309659.690510:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecb40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210555776:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788309659.690540:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309659.690899:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210555904 00000100:00100000:1.0:1788309659.690907:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210555904 00000100:00100000:1.0:1788309659.690946:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788309659.690953:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecb43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14385:x1875178210555904:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788309659.691113:0:15048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210555776 00000100:00100000:2.0:1788309659.691117:0:15048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210555776 00000100:00100000:2.0:1788309659.691140:0:15048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788309659.691146:0:15048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc574e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3300:x1875178210555776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788309659.691166:0:15048:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788309659.691206:0:15048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc574e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3300:x1875178210555776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309659.691218:0:15048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000004:00080000:0.0:1788309659.691498:0:14384:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 422442220275ns, next at 0ns, rc = 0 00010000:00080000:3.0:1788309659.693672:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97c8ecb40380 x1875178210555776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788309675 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788309659.693701:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecb40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210555776:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788309659.697111:0:14358:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:1.0:1788309659.704318:0:15044:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1788309659.704329:0:15044:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1788309659.704335:0:15044:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00002000:00010000:1.0:1788309659.718170:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788309659.718189:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000625c2c30/0x63a04852f46297e2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309659.718213:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=422s v=(0 0) 00010000:00010000:1.0:1788309659.718220:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788309659.718229:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000625c2c30/0x63a04852f46297e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309659.718254:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000625c2c30/0x63a04852f46297e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309659.718268:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000625c2c30/0x63a04852f46297e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309659.718328:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000625c2c30/0x63a04852f46297e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309659.718355:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788309659.718373:0:14351:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788309659.718387:0:14351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000625c2c30/0x63a04852f46297e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309659.718397:0:14351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8f5549400 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:1.0:1788309659.718403:0:14351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000625c2c30/0x63a04852f46297e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309659.718413:0:14351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000625c2c30/0x63a04852f46297e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309659.723003:0:14351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000625c2c30/0x63a04852f46297e2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309659.723030:0:14351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000625c2c30/0x63a04852f46297e2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309659.723068:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309659.723071:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309659.723074:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788309659.726202:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788309659.726216:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca4db15a/0x63a04852f46297e9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309659.726233:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=422s v=(0 0) 00010000:00010000:0.0:1788309659.726238:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788309659.726243:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca4db15a/0x63a04852f46297e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309659.726260:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ca4db15a/0x63a04852f46297e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309659.726270:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca4db15a/0x63a04852f46297e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309659.726327:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ca4db15a/0x63a04852f46297e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309659.726346:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788309659.726358:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788309659.726364:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ca4db15a/0x63a04852f46297e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309659.726371:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8ecf2ec00 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:0.0:1788309659.726375:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca4db15a/0x63a04852f46297e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309659.726390:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca4db15a/0x63a04852f46297e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309659.726407:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ca4db15a/0x63a04852f46297e9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309659.726414:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca4db15a/0x63a04852f46297e9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309659.726429:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309659.726431:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309659.726433:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788309659.727140:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788309659.727147:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8502e30/0x63a04852f46297f0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309659.727157:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=422s v=(0 0) 00010000:00010000:0.0:1788309659.727160:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788309659.727165:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8502e30/0x63a04852f46297f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309659.727175:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8502e30/0x63a04852f46297f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309659.727184:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8502e30/0x63a04852f46297f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309659.727198:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f8502e30/0x63a04852f46297f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309659.727220:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788309659.727358:0:14351:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788309659.727365:0:14351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f8502e30/0x63a04852f46297f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.727374:0:14351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8ecf2fc00 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:3.0:1788309659.727377:0:14351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8502e30/0x63a04852f46297f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.727385:0:14351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8502e30/0x63a04852f46297f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.727405:0:14351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f8502e30/0x63a04852f46297f0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.727411:0:14351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8502e30/0x63a04852f46297f0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.727426:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309659.727428:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309659.727429:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788309659.728648:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788309659.728659:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095f37e7f/0x63a04852f46297f7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309659.728670:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=422s v=(0 0) 00010000:00010000:0.0:1788309659.728674:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788309659.728679:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095f37e7f/0x63a04852f46297f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309659.728692:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095f37e7f/0x63a04852f46297f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309659.728701:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095f37e7f/0x63a04852f46297f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309659.728709:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095f37e7f/0x63a04852f46297f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309659.728731:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788309659.730142:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788309659.730153:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095f37e7f/0x63a04852f46297f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309659.730165:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8ecf2fa00 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:1.0:1788309659.730170:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095f37e7f/0x63a04852f46297f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309659.730192:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095f37e7f/0x63a04852f46297f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309659.730213:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095f37e7f/0x63a04852f46297f7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309659.730220:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095f37e7f/0x63a04852f46297f7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309659.730238:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309659.730240:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309659.730242:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788309659.733243:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788309659.733254:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000625c2c30/0x63a04852f46297fe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309659.733271:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=422s v=(0 0) 00010000:00010000:1.0:1788309659.733313:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788309659.733321:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000625c2c30/0x63a04852f46297fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309659.733335:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000625c2c30/0x63a04852f46297fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309659.733346:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000625c2c30/0x63a04852f46297fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309659.733361:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000625c2c30/0x63a04852f46297fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309659.733380:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788309659.733393:0:14351:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788309659.733398:0:14351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000625c2c30/0x63a04852f46297fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309659.733406:0:14351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8f5549400 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:1.0:1788309659.733410:0:14351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000625c2c30/0x63a04852f46297fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309659.733419:0:14351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000625c2c30/0x63a04852f46297fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309659.733445:0:14351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000625c2c30/0x63a04852f46297fe lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309659.733453:0:14351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000625c2c30/0x63a04852f46297fe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309659.733469:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309659.733471:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309659.733477:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788309659.734240:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788309659.734254:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eae37608/0x63a04852f4629805 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309659.734264:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=422s v=(0 0) 00010000:00010000:1.0:1788309659.734268:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788309659.734273:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eae37608/0x63a04852f4629805 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309659.734316:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eae37608/0x63a04852f4629805 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309659.734327:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eae37608/0x63a04852f4629805 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309659.734335:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eae37608/0x63a04852f4629805 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309659.734354:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788309659.734757:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788309659.734767:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eae37608/0x63a04852f4629805 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.734778:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8f5548e00 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:3.0:1788309659.734783:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eae37608/0x63a04852f4629805 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.734793:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eae37608/0x63a04852f4629805 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.734809:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eae37608/0x63a04852f4629805 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788309659.734813:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788309659.734822:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eae37608/0x63a04852f4629805 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309659.734823:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047676437/0x63a04852f462980c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309659.734841:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=422s v=(0 0) 00010000:00010000:1.0:1788309659.734848:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788309659.734856:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047676437/0x63a04852f462980c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.734866:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309659.734868:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047676437/0x63a04852f462980c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.734869:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309659.734872:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309659.734883:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047676437/0x63a04852f462980c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309659.734892:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047676437/0x63a04852f462980c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309659.734907:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788309659.734916:0:14351:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788309659.734920:0:14351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047676437/0x63a04852f462980c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309659.734927:0:14351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8f5548800 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:1.0:1788309659.734930:0:14351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047676437/0x63a04852f462980c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309659.734938:0:14351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047676437/0x63a04852f462980c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309659.734947:0:14351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047676437/0x63a04852f462980c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309659.734954:0:14351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047676437/0x63a04852f462980c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309659.734967:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309659.734973:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309659.734975:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788309659.735424:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788309659.735431:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab37f48c/0x63a04852f4629813 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309659.735451:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=422s v=(0 0) 00010000:00010000:1.0:1788309659.735455:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788309659.735459:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab37f48c/0x63a04852f4629813 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309659.735470:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab37f48c/0x63a04852f4629813 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309659.735479:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab37f48c/0x63a04852f4629813 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309659.735486:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab37f48c/0x63a04852f4629813 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309659.735500:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788309659.735541:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788309659.735548:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab37f48c/0x63a04852f4629813 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.735558:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8f5549a00 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:3.0:1788309659.735562:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab37f48c/0x63a04852f4629813 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.735571:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab37f48c/0x63a04852f4629813 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.735584:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab37f48c/0x63a04852f4629813 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.735592:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab37f48c/0x63a04852f4629813 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.735607:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309659.735609:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309659.735612:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788309659.735865:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788309659.735870:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080b6f1cd/0x63a04852f462981a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309659.735878:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=422s v=(0 0) 00010000:00010000:1.0:1788309659.735881:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788309659.735884:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080b6f1cd/0x63a04852f462981a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309659.735897:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080b6f1cd/0x63a04852f462981a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309659.735905:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080b6f1cd/0x63a04852f462981a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309659.735911:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080b6f1cd/0x63a04852f462981a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309659.735933:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788309659.735974:0:14351:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788309659.735980:0:14351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080b6f1cd/0x63a04852f462981a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.736000:0:14351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8f5549800 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:3.0:1788309659.736004:0:14351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080b6f1cd/0x63a04852f462981a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.736013:0:14351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080b6f1cd/0x63a04852f462981a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.736035:0:14351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080b6f1cd/0x63a04852f462981a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.736043:0:14351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080b6f1cd/0x63a04852f462981a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.736060:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309659.736062:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309659.736066:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788309659.736343:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788309659.736348:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074d7d98e/0x63a04852f4629821 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309659.736356:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=422s v=(0 0) 00010000:00010000:1.0:1788309659.736359:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788309659.736363:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074d7d98e/0x63a04852f4629821 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309659.736371:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074d7d98e/0x63a04852f4629821 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309659.736378:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074d7d98e/0x63a04852f4629821 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309659.736393:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000074d7d98e/0x63a04852f4629821 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309659.736412:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788309659.736462:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788309659.736467:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000074d7d98e/0x63a04852f4629821 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.736475:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8f5549e00 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:3.0:1788309659.736479:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000074d7d98e/0x63a04852f4629821 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.736488:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000074d7d98e/0x63a04852f4629821 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.736506:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000074d7d98e/0x63a04852f4629821 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.736514:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074d7d98e/0x63a04852f4629821 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.736528:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309659.736530:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309659.736532:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788309659.743139:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788309659.743152:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb6a6b8e/0x63a04852f4629828 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.743170:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=422s v=(0 0) 00010000:00010000:3.0:1788309659.743175:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788309659.743181:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb6a6b8e/0x63a04852f4629828 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.743196:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb6a6b8e/0x63a04852f4629828 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.743207:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb6a6b8e/0x63a04852f4629828 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.743215:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eb6a6b8e/0x63a04852f4629828 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.743250:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788309659.743970:0:14351:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788309659.743983:0:14351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eb6a6b8e/0x63a04852f4629828 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309659.743997:0:14351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8c153a400 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:1.0:1788309659.744004:0:14351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb6a6b8e/0x63a04852f4629828 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309659.744017:0:14351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb6a6b8e/0x63a04852f4629828 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309659.744039:0:14351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eb6a6b8e/0x63a04852f4629828 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309659.744048:0:14351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb6a6b8e/0x63a04852f4629828 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309659.744071:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309659.744073:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309659.744075:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788309659.745508:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788309659.745520:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040bb116f/0x63a04852f462982f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.745537:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=422s v=(0 0) 00010000:00010000:3.0:1788309659.745541:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788309659.745548:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040bb116f/0x63a04852f462982f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.745564:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040bb116f/0x63a04852f462982f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.745574:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040bb116f/0x63a04852f462982f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.745583:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000040bb116f/0x63a04852f462982f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.745605:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788309659.745619:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788309659.745693:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000040bb116f/0x63a04852f462982f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.745704:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8c153bc00 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:3.0:1788309659.745716:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000040bb116f/0x63a04852f462982f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.745725:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000040bb116f/0x63a04852f462982f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.745743:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000040bb116f/0x63a04852f462982f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.745749:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040bb116f/0x63a04852f462982f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.745769:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309659.745772:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309659.745774:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788309659.746715:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788309659.746724:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd8c1685/0x63a04852f4629836 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.746736:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=422s v=(0 0) 00010000:00010000:3.0:1788309659.746740:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788309659.746746:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd8c1685/0x63a04852f4629836 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.746758:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd8c1685/0x63a04852f4629836 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.746767:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd8c1685/0x63a04852f4629836 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.746782:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd8c1685/0x63a04852f4629836 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.746800:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788309659.746932:0:14351:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788309659.746945:0:14351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd8c1685/0x63a04852f4629836 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309659.746955:0:14351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8c153ba00 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:1.0:1788309659.746959:0:14351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd8c1685/0x63a04852f4629836 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309659.746969:0:14351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd8c1685/0x63a04852f4629836 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309659.746985:0:14351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd8c1685/0x63a04852f4629836 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309659.746994:0:14351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd8c1685/0x63a04852f4629836 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309659.747011:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309659.747013:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309659.747015:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788309659.747535:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788309659.747542:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be04d33a/0x63a04852f462983d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.747552:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=422s v=(0 0) 00010000:00010000:3.0:1788309659.747555:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788309659.747559:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be04d33a/0x63a04852f462983d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.747570:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be04d33a/0x63a04852f462983d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.747580:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be04d33a/0x63a04852f462983d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.747587:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000be04d33a/0x63a04852f462983d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.747604:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788309659.747613:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788309659.747617:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000be04d33a/0x63a04852f462983d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.747983:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8c153be00 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:3.0:1788309659.747987:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000be04d33a/0x63a04852f462983d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.747996:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000be04d33a/0x63a04852f462983d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.748011:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000be04d33a/0x63a04852f462983d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.748018:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be04d33a/0x63a04852f462983d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.748034:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309659.748036:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309659.748038:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788309659.749186:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788309659.749197:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076b14d99/0x63a04852f4629844 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.749211:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=422s v=(0 0) 00010000:00010000:3.0:1788309659.749215:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788309659.749221:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076b14d99/0x63a04852f4629844 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.749233:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076b14d99/0x63a04852f4629844 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.749251:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076b14d99/0x63a04852f4629844 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.749260:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076b14d99/0x63a04852f4629844 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.749297:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1788309659.750025:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:3.0:1788309659.750051:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788309659.750059:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eaffa74f/0x63a04852f462984b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.750069:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=422s v=(0 0) 00010000:00010000:3.0:1788309659.750073:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788309659.750077:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eaffa74f/0x63a04852f462984b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.750087:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eaffa74f/0x63a04852f462984b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.750097:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eaffa74f/0x63a04852f462984b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.750104:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eaffa74f/0x63a04852f462984b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.750133:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788309659.750155:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788309659.750164:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076b14d99/0x63a04852f4629844 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.750174:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8c153a000 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:2.0:1788309659.750179:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076b14d99/0x63a04852f4629844 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.750188:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076b14d99/0x63a04852f4629844 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.750209:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076b14d99/0x63a04852f4629844 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.750217:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076b14d99/0x63a04852f4629844 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.750237:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788309659.750241:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eaffa74f/0x63a04852f462984b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.750247:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8c153ac00 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:2.0:1788309659.750251:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eaffa74f/0x63a04852f462984b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.750354:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eaffa74f/0x63a04852f462984b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.750366:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eaffa74f/0x63a04852f462984b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.750374:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eaffa74f/0x63a04852f462984b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.750387:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309659.750389:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309659.750390:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788309659.750739:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788309659.750746:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0a92bcf/0x63a04852f4629852 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.750755:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=422s v=(0 0) 00010000:00010000:3.0:1788309659.750758:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788309659.750763:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0a92bcf/0x63a04852f4629852 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.750774:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0a92bcf/0x63a04852f4629852 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.750782:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0a92bcf/0x63a04852f4629852 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.750790:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0a92bcf/0x63a04852f4629852 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.750812:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788309659.751001:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788309659.751007:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0a92bcf/0x63a04852f4629852 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.751015:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8c153a200 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:2.0:1788309659.751018:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0a92bcf/0x63a04852f4629852 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.751026:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0a92bcf/0x63a04852f4629852 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.751038:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0a92bcf/0x63a04852f4629852 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.751058:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0a92bcf/0x63a04852f4629852 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.751074:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309659.751076:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309659.751078:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309659.751863:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788309659.752047:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788309659.752055:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d69ac30/0x63a04852f4629859 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.752068:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=422s v=(0 0) 00010000:00010000:2.0:1788309659.752072:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788309659.752077:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d69ac30/0x63a04852f4629859 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.752087:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d69ac30/0x63a04852f4629859 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.752096:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d69ac30/0x63a04852f4629859 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.752105:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d69ac30/0x63a04852f4629859 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.752121:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788309659.752137:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788309659.752142:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d69ac30/0x63a04852f4629859 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.752149:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8fc935600 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:2.0:1788309659.752154:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d69ac30/0x63a04852f4629859 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.752163:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d69ac30/0x63a04852f4629859 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.752176:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d69ac30/0x63a04852f4629859 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.752184:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d69ac30/0x63a04852f4629859 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.752198:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309659.752200:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309659.752202:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788309659.752791:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788309659.752797:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fafe87c/0x63a04852f4629860 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.752806:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=422s v=(0 0) 00010000:00010000:2.0:1788309659.752810:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788309659.752813:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006fafe87c/0x63a04852f4629860 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.752834:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006fafe87c/0x63a04852f4629860 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.752842:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fafe87c/0x63a04852f4629860 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.752849:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006fafe87c/0x63a04852f4629860 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.752864:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788309659.752874:0:14351:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788309659.752879:0:14351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006fafe87c/0x63a04852f4629860 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.752886:0:14351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8fc934200 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:2.0:1788309659.752890:0:14351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006fafe87c/0x63a04852f4629860 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.752897:0:14351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006fafe87c/0x63a04852f4629860 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.752909:0:14351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006fafe87c/0x63a04852f4629860 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.752916:0:14351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006fafe87c/0x63a04852f4629860 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.752936:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309659.752938:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309659.752940:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788309659.753445:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788309659.753452:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7bb7495/0x63a04852f4629867 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.753461:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=422s v=(0 0) 00010000:00010000:2.0:1788309659.753464:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788309659.753470:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7bb7495/0x63a04852f4629867 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.753479:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7bb7495/0x63a04852f4629867 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.753488:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7bb7495/0x63a04852f4629867 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.753494:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e7bb7495/0x63a04852f4629867 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.753510:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788309659.753519:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788309659.753523:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e7bb7495/0x63a04852f4629867 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.753543:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8fc934a00 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:2.0:1788309659.753547:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7bb7495/0x63a04852f4629867 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.753555:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7bb7495/0x63a04852f4629867 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.753569:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e7bb7495/0x63a04852f4629867 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.753576:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7bb7495/0x63a04852f4629867 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.753593:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309659.753595:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309659.753597:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788309659.753967:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788309659.753973:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d75f622/0x63a04852f462986e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.753983:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=422s v=(0 0) 00010000:00010000:2.0:1788309659.753986:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788309659.753990:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d75f622/0x63a04852f462986e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.753999:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d75f622/0x63a04852f462986e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.754013:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d75f622/0x63a04852f462986e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.754020:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d75f622/0x63a04852f462986e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.754034:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788309659.754042:0:14351:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788309659.754046:0:14351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d75f622/0x63a04852f462986e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.754054:0:14351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8fc935e00 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:2.0:1788309659.754057:0:14351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d75f622/0x63a04852f462986e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.754064:0:14351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d75f622/0x63a04852f462986e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.754074:0:14351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d75f622/0x63a04852f462986e lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.754081:0:14351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d75f622/0x63a04852f462986e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.754093:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309659.754099:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309659.754100:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788309659.754815:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788309659.754824:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad49f450/0x63a04852f4629875 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.754835:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=422s v=(0 0) 00010000:00010000:2.0:1788309659.754839:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788309659.754844:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad49f450/0x63a04852f4629875 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.754856:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad49f450/0x63a04852f4629875 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.754865:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad49f450/0x63a04852f4629875 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.754874:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad49f450/0x63a04852f4629875 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.754891:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788309659.754958:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788309659.754963:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad49f450/0x63a04852f4629875 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.754971:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8fc934400 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:2.0:1788309659.754975:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad49f450/0x63a04852f4629875 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.754996:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad49f450/0x63a04852f4629875 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.755009:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad49f450/0x63a04852f4629875 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.755018:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad49f450/0x63a04852f4629875 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.755034:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309659.755036:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309659.755038:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788309659.756637:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788309659.756647:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9f6cacf/0x63a04852f462987c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.756660:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=422s v=(0 0) 00010000:00010000:2.0:1788309659.756664:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788309659.756671:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9f6cacf/0x63a04852f462987c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.756683:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9f6cacf/0x63a04852f462987c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.756692:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9f6cacf/0x63a04852f462987c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.756713:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e9f6cacf/0x63a04852f462987c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.756772:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788309659.757225:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788309659.757231:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c26aaa41/0x63a04852f4629883 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.757240:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=422s v=(0 0) 00010000:00010000:2.0:1788309659.757243:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788309659.757248:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c26aaa41/0x63a04852f4629883 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.757257:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c26aaa41/0x63a04852f4629883 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.757265:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c26aaa41/0x63a04852f4629883 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.757273:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c26aaa41/0x63a04852f4629883 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.757623:0:14351:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788309659.757632:0:14351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e9f6cacf/0x63a04852f462987c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.757641:0:14351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8fc934800 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:3.0:1788309659.757653:0:14351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9f6cacf/0x63a04852f462987c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.757662:0:14351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9f6cacf/0x63a04852f462987c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.757680:0:14351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e9f6cacf/0x63a04852f462987c lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.757688:0:14351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9f6cacf/0x63a04852f462987c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.757707:0:14351:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788309659.757711:0:14351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c26aaa41/0x63a04852f4629883 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.757717:0:14351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8fc935a00 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:3.0:1788309659.757721:0:14351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c26aaa41/0x63a04852f4629883 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.757729:0:14351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c26aaa41/0x63a04852f4629883 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.757738:0:14351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c26aaa41/0x63a04852f4629883 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.757745:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309659.757752:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309659.757754:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309659.757824:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788309659.757830:0:15044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c26aaa41/0x63a04852f4629883 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788309659.758531:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788309659.758540:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe29b487/0x63a04852f462988a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.758551:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=422s v=(0 0) 00010000:00010000:2.0:1788309659.758554:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788309659.758560:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe29b487/0x63a04852f462988a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.758571:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe29b487/0x63a04852f462988a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.758581:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe29b487/0x63a04852f462988a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.758590:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fe29b487/0x63a04852f462988a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.758648:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788309659.758654:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fe29b487/0x63a04852f462988a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.758662:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8fc934c00 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:3.0:1788309659.758666:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe29b487/0x63a04852f462988a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.758674:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe29b487/0x63a04852f462988a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.758687:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fe29b487/0x63a04852f462988a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.758695:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309659.758697:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309659.758698:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309659.758762:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788309659.758767:0:15044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe29b487/0x63a04852f462988a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788309659.759323:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788309659.759467:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6a935de/0x63a04852f4629891 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.759492:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=422s v=(0 0) 00010000:00010000:2.0:1788309659.759495:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788309659.759501:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6a935de/0x63a04852f4629891 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.759511:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6a935de/0x63a04852f4629891 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.759520:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6a935de/0x63a04852f4629891 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.759528:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6a935de/0x63a04852f4629891 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.759575:0:14351:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788309659.759581:0:14351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6a935de/0x63a04852f4629891 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.759589:0:14351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8fc935c00 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:3.0:1788309659.759593:0:14351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6a935de/0x63a04852f4629891 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.759602:0:14351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6a935de/0x63a04852f4629891 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.759624:0:14351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6a935de/0x63a04852f4629891 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.759633:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309659.759635:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309659.759638:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309659.759706:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788309659.759711:0:15044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6a935de/0x63a04852f4629891 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788309659.760301:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788309659.760308:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008bc4adf0/0x63a04852f4629898 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.760318:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=422s v=(0 0) 00010000:00010000:2.0:1788309659.760322:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788309659.760327:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008bc4adf0/0x63a04852f4629898 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.760491:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008bc4adf0/0x63a04852f4629898 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.760501:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008bc4adf0/0x63a04852f4629898 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309659.760510:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008bc4adf0/0x63a04852f4629898 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.760567:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788309659.760573:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008bc4adf0/0x63a04852f4629898 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.760581:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d9000 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:3.0:1788309659.760585:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008bc4adf0/0x63a04852f4629898 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.760594:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008bc4adf0/0x63a04852f4629898 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.760609:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008bc4adf0/0x63a04852f4629898 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.760618:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309659.760621:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309659.760623:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309659.760692:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788309659.760698:0:15044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008bc4adf0/0x63a04852f4629898 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.761533:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788309659.764783:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788309659.764797:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be04d33a/0x63a04852f462989f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.764820:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=422s v=(0 0) 00010000:00010000:3.0:1788309659.764824:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788309659.764831:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be04d33a/0x63a04852f462989f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.764846:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be04d33a/0x63a04852f462989f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.764857:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be04d33a/0x63a04852f462989f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.764866:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000be04d33a/0x63a04852f462989f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.764890:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788309659.764979:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788309659.764986:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000be04d33a/0x63a04852f462989f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.764994:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8c153be00 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:3.0:1788309659.765000:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000be04d33a/0x63a04852f462989f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.765010:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000be04d33a/0x63a04852f462989f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.765041:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000be04d33a/0x63a04852f462989f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.765048:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be04d33a/0x63a04852f462989f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309659.765069:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309659.765071:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309659.765073:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1788309659.765481:0:15044:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:3.0:1788309659.765611:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecb43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14385:x1875178210555904:12345-0@lo:5:osp-pre-0-0.0 Request processed in 74653us (75382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309659.765624:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788309659.766376:0:14385:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecb42a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14385:1875178210555904:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788309659.766394:0:14385:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:0.0:1788309659.766473:0:14385:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffbb1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14385:1875178210556032:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788309659.766531:0:14385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309659.766575:0:14385:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8ea1c8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788309659.766596:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210556032 00000100:00100000:0.0:1788309659.766601:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210556032 00000100:00100000:0.0:1788309659.766637:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788309659.766642:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffbb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14385:x1875178210556032:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788309659.766720:0:15046:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:0.0:1788309659.780919:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffbb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14385:x1875178210556032:12345-0@lo:5:osp-pre-0-0.0 Request processed in 14266us (14378us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788309659.780933:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788309659.781011:0:14385:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffbb1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14385:1875178210556032:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788309659.781030:0:14385:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:3.0:1788309660.322831:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309661.345560:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788309661.810221:0:15762:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788309661.810227:0:15762:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1788309661.810462:0:15762:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff97c8d93c7800 00000020:01000004:3.0:1788309661.810484:0:15762:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788309661.810502:0:15762:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1788309661.810536:0:15762:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff97c7c341cd28) 00000020:00000080:3.0:1788309661.810559:0:15762:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788309661.832960:0:15762:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788309661.833507:0:15762:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788309661.834707:0:15762:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788309661.834975:0:15762:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1788309661.835683:0:15762:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1788309661.836336:0:15762:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 250: rc = 0 00100000:10000000:3.0:1788309661.836454:0:15762:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 250: rc = 0 00100000:10000000:3.0:1788309661.836556:0:15762:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 250: rc = 0 00100000:10000000:3.0:1788309661.838571:0:15762:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 523: rc = 0 00100000:10000000:3.0:1788309661.838914:0:15762:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 523: rc = 0 00100000:10000000:3.0:1788309661.839433:0:15762:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 523: rc = 0 00100000:10000000:3.0:1788309661.839719:0:15762:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 523: rc = 0 00100000:10000000:3.0:1788309661.839986:0:15762:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 523: rc = 0 00100000:10000000:3.0:1788309661.840532:0:15762:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 523: rc = 0 00000020:00000080:3.0:1788309661.841481:0:15762:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788309661.841499:0:15762:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788309661.841513:0:15762:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x63a04852f46298ad 00000020:01000004:3.0:1788309661.841525:0:15762:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1788309661.841556:0:15762:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.155@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788309661.841560:0:15762:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.155@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788309661.841568:0:15762:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788309661.841614:0:15762:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1788309661.841621:0:15762:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.155@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788309661.853498:0:15762:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.155@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788309661.853554:0:15762:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.155@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1788309661.853560:0:15762:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788309661.853562:0:15762:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788309661.853564:0:15762:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788309661.853565:0:15762:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788309661.853566:0:15762:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788309661.853567:0:15762:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788309661.853569:0:15762:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788309661.853571:0:15762:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788309661.853573:0:15762:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788309661.853578:0:15762:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1788309661.853580:0:15762:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788309661.853582:0:15762:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788309661.853588:0:15762:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788309661.853589:0:15762:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788309661.853590:0:15762:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788309661.853591:0:15762:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788309661.853592:0:15762:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788309661.853592:0:15762:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788309661.853593:0:15762:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788309661.853631:0:15762:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788309661.853659:0:15762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc577100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:15762:1875178210556160:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788309661.853778:0:15762:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309661.853916:0:15762:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d6aeef00 going to sleep for 11 seconds 00000100:00100000:2.0:1788309661.854077:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210556160 00000100:00100000:2.0:1788309661.854087:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210556160 00000100:00100000:2.0:1788309661.854199:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788309661.854212:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ee539450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1139bce-bc3d-41b1-9121-b11888b6dcf4+16:15762:x1875178210556160:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788309661.854249:0:14357:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788309661.854253:0:14357:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1788309661.854257:0:14357:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788309661.865623:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ee539450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1139bce-bc3d-41b1-9121-b11888b6dcf4+16:15762:x1875178210556160:12345-0@lo:253:mount.lustre.0 Request processed in 11395us (11827us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309661.865646:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788309661.865768:0:15762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc577100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:15762:1875178210556160:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788309661.865792:0:15762:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788309661.865797:0:15762:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788309661.865799:0:15762:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788309661.865801:0:15762:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788309661.865802:0:15762:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788309661.865803:0:15762:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788309661.865805:0:15762:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788309661.865807:0:15762:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788309661.865810:0:15762:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788309661.865812:0:15762:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788309661.865847:0:15762:0:(tgt_mount.c:101:server_register_mount()) register mount ffff97c8d93c7800 from lustre-OST0001 10000000:01000000:3.0:1788309661.865883:0:15762:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788309661.865887:0:15762:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788309661.865899:0:15762:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff97c8f4f319b8 local copy 00010000:00010000:3.0:1788309661.865912:0:15762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8c153b600/0x63a04852f4629653 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f462965a expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309661.866743:0:15762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc577100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:15762:1875178210556288:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788309661.866809:0:15762:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309661.866917:0:15762:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d6aee540 going to sleep for 11 seconds 00000100:00100000:2.0:1788309661.866969:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210556288 00000100:00100000:2.0:1788309661.866977:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210556288 00000100:00100000:2.0:1788309661.867154:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788309661.867166:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ee53ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1139bce-bc3d-41b1-9121-b11888b6dcf4+16:15762:x1875178210556288:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788309661.867448:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ee53ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1139bce-bc3d-41b1-9121-b11888b6dcf4+16:15762:x1875178210556288:12345-0@lo:501:mount.lustre.0 Request processed in 284us (637us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788309661.867463:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788309661.867583:0:15762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc577100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:15762:1875178210556288:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788309661.867613:0:15762:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.155@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788309661.867781:0:15762:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.155@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788309661.867792:0:15762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8c153b600/0x63a04852f4629653 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f462965a expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309661.867804:0:15762:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff97c8c153b600/0x63a04852f4629653 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f462965a expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788309661.867839:0:15762:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff97c8d93c7800 10000000:01000000:3.0:1788309661.867844:0:15762:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788309661.867850:0:15762:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788309661.867854:0:15762:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788309661.867859:0:15762:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788309661.867862:0:15762:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788309661.867896:0:15762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8c153bc00/0x63a04852f46298b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309661.867905:0:15762:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff97c8c153bc00/0x63a04852f46298b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309661.867917:0:15762:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff97c8c153bc00/0x63a04852f46298b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309661.867935:0:15762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc577100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:15762:1875178210556416:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788309661.867971:0:15762:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309661.868103:0:15762:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d6aee540 going to sleep for 11 seconds 00000100:00100000:0.0:1788309661.868263:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210556416 00000100:00100000:0.0:1788309661.868270:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210556416 00000100:00100000:0.0:1788309661.868322:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788309661.868331:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ee539050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1139bce-bc3d-41b1-9121-b11888b6dcf4+16:15762:x1875178210556416:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788309661.868343:0:14356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788309661.868359:0:14356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c8ecf2fc00/0x63a04852f46298bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x63a04852f46298b4 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309661.868389:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8ecf2fc00/0x63a04852f46298bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63a04852f46298b4 expref: 17 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309661.868402:0:14356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c8ecf2fc00/0x63a04852f46298bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f46298b4 expref: 17 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309661.868435:0:14356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8ecf2fc00, rc 0) 00000100:00100000:0.0:1788309661.868480:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ee539050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1139bce-bc3d-41b1-9121-b11888b6dcf4+17:15762:x1875178210556416:12345-0@lo:101:mount.lustre.0 Request processed in 150us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309661.868486:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788309661.868620:0:15762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc577100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:15762:1875178210556416:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788309661.868636:0:15762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff97c8c153bc00/0x63a04852f46298b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f46298bb expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309661.868652:0:15762:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff97c8c153bc00/0x63a04852f46298b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x63a04852f46298bb expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788309661.869784:0:15762:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1788309661.871081:0:15762:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788309661.871569:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1788309661.871625:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1788309661.871680:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1788309661.871739:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1788309661.871780:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1788309661.872180:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1788309661.872272:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1788309661.872557:0:15762:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1788309661.872696:0:15762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc577100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:15762:1875178210556544:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788309661.872804:0:15762:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309661.872870:0:15762:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d6aee300 going to sleep for 11 seconds 00000100:00100000:2.0:1788309661.872957:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210556544 00000100:00100000:2.0:1788309661.872967:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210556544 00000100:00100000:2.0:1788309661.873148:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788309661.873162:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ee53a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1139bce-bc3d-41b1-9121-b11888b6dcf4+17:15762:x1875178210556544:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788309661.873709:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ee53a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1139bce-bc3d-41b1-9121-b11888b6dcf4+17:15762:x1875178210556544:12345-0@lo:501:mount.lustre.0 Request processed in 549us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309661.873718:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788309661.873844:0:15762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc577100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:15762:1875178210556544:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788309661.873909:0:15762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecb41500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:15762:1875178210556672:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788309661.873967:0:15762:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309661.874263:0:15762:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c258d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788309661.874453:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210556672 00000100:00100000:3.0:1788309661.874461:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210556672 00000100:00100000:3.0:1788309661.874499:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788309661.874508:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ee53a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1139bce-bc3d-41b1-9121-b11888b6dcf4+17:15762:x1875178210556672:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788309661.874929:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ee53a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1139bce-bc3d-41b1-9121-b11888b6dcf4+17:15762:x1875178210556672:12345-0@lo:503:mount.lustre.0 Request processed in 421us (961us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309661.874937:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788309661.875427:0:15762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecb41500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:15762:1875178210556672:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788309661.876327:0:15762:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788309661.876443:0:15762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecb41500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:15762:1875178210556800:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788309661.876529:0:15762:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309661.876580:0:15762:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8fc91ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1788309661.876673:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210556800 00000100:00100000:2.0:1788309661.876683:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210556800 00000100:00100000:2.0:1788309661.876737:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788309661.876748:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ee539c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1139bce-bc3d-41b1-9121-b11888b6dcf4+17:15762:x1875178210556800:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788309661.877133:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ee539c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1139bce-bc3d-41b1-9121-b11888b6dcf4+17:15762:x1875178210556800:12345-0@lo:502:mount.lustre.0 Request processed in 384us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309661.877141:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788309661.878155:0:15762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecb41500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:15762:1875178210556800:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788309661.878542:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1788309661.878620:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1788309661.878674:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1788309661.878726:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1788309661.878759:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1788309661.878792:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1788309661.878842:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1788309661.878880:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1788309661.878931:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1788309661.878983:0:15762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecb41500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:15762:1875178210556928:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788309661.879531:0:15762:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309661.879594:0:15762:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8fc91ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1788309661.879670:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210556928 00000100:00100000:2.0:1788309661.879680:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210556928 00000100:00100000:2.0:1788309661.879774:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788309661.879787:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6851c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1139bce-bc3d-41b1-9121-b11888b6dcf4+17:15762:x1875178210556928:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788309661.880085:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6851c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1139bce-bc3d-41b1-9121-b11888b6dcf4+17:15762:x1875178210556928:12345-0@lo:502:mount.lustre.0 Request processed in 299us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309661.880093:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788309661.880193:0:15762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecb41500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:15762:1875178210556928:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788309661.880331:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1788309661.880346:0:15762:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1788309661.881528:0:15764:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788309661.881541:0:15764:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1788309661.881552:0:15764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788309661.881555:0:15764:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788309661.881564:0:15764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788309661.881588:0:15764:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff97c8ecf78000) 00000020:00000080:1.0:1788309661.881622:0:15764:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788309661.881644:0:15764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788309661.881766:0:15764:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97c8d93c7800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788309661.881776:0:15764:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788309661.881787:0:15764:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x63a04852f46298c9 00010000:00010000:1.0:1788309661.886736:0:15764:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1788309661.887505:0:15764:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:1.0:1788309661.889756:0:15764:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1788309661.892504:0:15764:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788309661.892522:0:15764:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788309661.892531:0:15764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788309661.892533:0:15764:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788309661.892537:0:15764:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788309661.892543:0:15764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788309661.892544:0:15764:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788309661.892547:0:15764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788309661.892550:0:15764:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788309661.892552:0:15764:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788309661.892555:0:15764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788309661.892556:0:15764:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788309661.892559:0:15764:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788309661.892561:0:15764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788309661.892563:0:15764:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788309661.892567:0:15764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788309661.892655:0:15764:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788309661.892659:0:15764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788309661.892660:0:15764:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788309661.892664:0:15764:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1788309661.892861:0:15762:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1788309661.892899:0:15762:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788309661.892922:0:15762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8c153bc00/0x63a04852f46298b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f46298bb expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309661.892954:0:15762:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff97c8c153bc00/0x63a04852f46298b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f46298bb expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788309661.892966:0:15762:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97c8d93c7800 from 1 10000000:01000000:2.0:1788309661.892970:0:15762:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788309661.893103:0:15762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8600/0x63a04852f46298d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309661.893113:0:15762:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8600/0x63a04852f46298d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309661.893129:0:15762:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8600/0x63a04852f46298d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309661.893166:0:15762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:15762:1875178210557056:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788309661.893266:0:15762:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309661.893352:0:15762:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c2f3f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788309661.893516:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210557056 00000100:00100000:1.0:1788309661.893527:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210557056 00000100:00100000:1.0:1788309661.893590:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788309661.893603:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6851050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1139bce-bc3d-41b1-9121-b11888b6dcf4+17:15762:x1875178210557056:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788309661.893621:0:14357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788309661.893645:0:14357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c8f5548a00/0x63a04852f46298d7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x63a04852f46298d0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309661.893676:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8f5548a00/0x63a04852f46298d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63a04852f46298d0 expref: 18 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309661.893689:0:14357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c8f5548a00/0x63a04852f46298d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f46298d0 expref: 18 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309661.893699:0:14357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8f5548a00, rc 0) 00000100:00100000:1.0:1788309661.893746:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6851050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1139bce-bc3d-41b1-9121-b11888b6dcf4+18:15762:x1875178210557056:12345-0@lo:101:mount.lustre.0 Request processed in 146us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309661.893753:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788309661.893879:0:15762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:15762:1875178210557056:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788309661.893898:0:15762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8600/0x63a04852f46298d0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f46298d7 expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309661.893908:0:15762:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8600/0x63a04852f46298d0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x63a04852f46298d7 expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788309661.894758:0:15762:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1788309661.897543:0:15762:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788309661.897955:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1788309661.899211:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1788309661.899493:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1788309661.899503:0:15762:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1788309661.899656:0:15762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:15762:1875178210557184:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788309661.899765:0:15762:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309661.899835:0:15762:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c2f3f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788309661.900112:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210557184 00000100:00100000:3.0:1788309661.900122:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210557184 00000100:00100000:3.0:1788309661.900195:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788309661.900208:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6853c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1139bce-bc3d-41b1-9121-b11888b6dcf4+18:15762:x1875178210557184:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788309661.900563:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6853c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1139bce-bc3d-41b1-9121-b11888b6dcf4+18:15762:x1875178210557184:12345-0@lo:501:mount.lustre.0 Request processed in 357us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309661.900572:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788309661.901495:0:15762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:15762:1875178210557184:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788309661.901560:0:15762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:15762:1875178210557312:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788309661.902253:0:15762:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309661.902334:0:15762:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c2f3f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788309661.902581:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210557312 00000100:00100000:3.0:1788309661.902592:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210557312 00000100:00100000:3.0:1788309661.902639:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788309661.902649:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6853050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1139bce-bc3d-41b1-9121-b11888b6dcf4+18:15762:x1875178210557312:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788309661.902916:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6853050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1139bce-bc3d-41b1-9121-b11888b6dcf4+18:15762:x1875178210557312:12345-0@lo:503:mount.lustre.0 Request processed in 266us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309661.902925:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788309661.903160:0:15762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:15762:1875178210557312:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788309661.905289:0:15762:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788309661.905431:0:15762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffbb2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:15762:1875178210557440:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788309661.905536:0:15762:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309661.905670:0:15762:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8e1ef7000 going to sleep for 11 seconds 00000100:00100000:2.0:1788309661.907795:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210557440 00000100:00100000:2.0:1788309661.907814:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210557440 00000100:00100000:3.0:1788309661.907964:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788309661.907977:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d7212c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1139bce-bc3d-41b1-9121-b11888b6dcf4+18:15762:x1875178210557440:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788309661.908340:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d7212c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1139bce-bc3d-41b1-9121-b11888b6dcf4+18:15762:x1875178210557440:12345-0@lo:502:mount.lustre.0 Request processed in 364us (2802us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309661.908349:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788309661.908432:0:15762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffbb2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:15762:1875178210557440:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788309661.908775:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788309661.908838:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1788309661.908904:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1788309661.908944:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1788309661.908999:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1788309661.909055:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1788309661.909092:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1788309661.909126:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1788309661.909174:0:15762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc577480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:15762:1875178210557568:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788309661.909233:0:15762:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309661.909308:0:15762:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d6aee3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788309661.909330:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210557568 00000100:00100000:3.0:1788309661.909336:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210557568 00000100:00100000:3.0:1788309661.909372:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788309661.909382:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ee53d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1139bce-bc3d-41b1-9121-b11888b6dcf4+18:15762:x1875178210557568:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788309661.909571:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ee53d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1139bce-bc3d-41b1-9121-b11888b6dcf4+18:15762:x1875178210557568:12345-0@lo:502:mount.lustre.0 Request processed in 190us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309661.909579:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788309661.909630:0:15762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc577480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:15762:1875178210557568:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788309661.909708:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1788309661.909717:0:15762:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1788309661.914434:0:15768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788309661.914455:0:15768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788309661.914459:0:15768:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788309661.914468:0:15768:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97c8d93c7800 00000020:00000080:2.0:1788309661.914471:0:15768:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788309661.914482:0:15768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788309661.914485:0:15768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788309661.914486:0:15768:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788309661.914489:0:15768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788309661.914491:0:15768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788309661.914492:0:15768:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788309661.914496:0:15768:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97c8d93c7800 00000020:00000080:2.0:1788309661.914498:0:15768:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788309661.914563:0:15768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788309661.914567:0:15768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788309661.914569:0:15768:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788309661.914572:0:15768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788309661.914575:0:15768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788309661.914576:0:15768:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788309661.914579:0:15768:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff97c8d93c7800 00000020:00000080:2.0:1788309661.914594:0:15768:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788309661.914634:0:15768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788309661.914637:0:15768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788309661.914638:0:15768:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788309661.914641:0:15768:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1788309661.916142:0:15762:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788309661.916196:0:15762:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788309661.916226:0:15762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8600/0x63a04852f46298d0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f46298d7 expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309661.916243:0:15762:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8600/0x63a04852f46298d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f46298d7 expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788309661.916324:0:15762:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788309661.916328:0:15762:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff97c8d93c7800 10000000:01000000:0.0:1788309661.916332:0:15762:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff97c8d93c7800 10000000:01000000:0.0:1788309661.916337:0:15762:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788309661.916345:0:15762:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97c8d93c7800 from 1 10000000:01000000:0.0:1788309661.916348:0:15762:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788309661.916403:0:15762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8ecf2fa00/0x63a04852f46298de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309661.916413:0:15762:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff97c8ecf2fa00/0x63a04852f46298de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309661.916451:0:15762:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff97c8ecf2fa00/0x63a04852f46298de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309661.916486:0:15762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffbb3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:15762:1875178210557696:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788309661.916586:0:15762:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309661.916651:0:15762:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8e1ef7d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788309661.917597:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210557696 00000100:00100000:0.0:1788309661.917609:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210557696 00000100:00100000:0.0:1788309661.917680:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788309661.917694:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ee53f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1139bce-bc3d-41b1-9121-b11888b6dcf4+18:15762:x1875178210557696:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788309661.917715:0:14356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788309661.917737:0:14356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c8ecf2f200/0x63a04852f46298e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x63a04852f46298de expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309661.917773:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8ecf2f200/0x63a04852f46298e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63a04852f46298de expref: 19 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309661.917787:0:14356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c8ecf2f200/0x63a04852f46298e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f46298de expref: 19 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309661.917798:0:14356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8ecf2f200, rc 0) 00000100:00100000:0.0:1788309661.919230:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ee53f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1139bce-bc3d-41b1-9121-b11888b6dcf4+19:15762:x1875178210557696:12345-0@lo:101:mount.lustre.0 Request processed in 1529us (2634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309661.919243:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788309661.921167:0:15762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffbb3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:15762:1875178210557696:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788309661.921209:0:15762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff97c8ecf2fa00/0x63a04852f46298de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f46298e5 expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309661.921224:0:15762:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff97c8ecf2fa00/0x63a04852f46298de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x63a04852f46298e5 expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788309661.925049:0:15762:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1788309661.925556:0:15762:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788309661.925889:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788309661.925941:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1788309661.925978:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1788309661.926042:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1788309661.926083:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1788309661.926148:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1788309661.926188:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1788309661.926224:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1788309661.926273:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1788309661.926347:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1788309661.926381:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1788309661.926445:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1788309661.926491:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1788309661.926544:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1788309661.926590:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1788309661.926623:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1788309661.926653:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1788309661.926699:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1788309661.926746:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1788309661.926778:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1788309661.926827:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1788309661.926864:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1788309661.926896:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1788309661.926942:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1788309661.926978:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1788309661.927012:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1788309661.927056:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1788309661.927093:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1788309661.927124:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1788309661.927187:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:2.0:1788309661.927222:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:2.0:1788309661.927252:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:2.0:1788309661.927310:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:2.0:1788309661.927360:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:2.0:1788309661.927397:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:2.0:1788309661.934708:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:2.0:1788309661.934817:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:2.0:1788309661.934942:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:2.0:1788309661.934951:0:15762:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1788309661.935115:0:15762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:15762:1875178210557824:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788309661.935220:0:15762:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309661.935337:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210557824 00000100:00100000:2.0:1788309661.935346:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210557824 00000100:00100000:2.0:1788309661.935436:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788309661.935449:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ee53c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1139bce-bc3d-41b1-9121-b11888b6dcf4+19:15762:x1875178210557824:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788309661.935789:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ee53c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1139bce-bc3d-41b1-9121-b11888b6dcf4+19:15762:x1875178210557824:12345-0@lo:501:mount.lustre.0 Request processed in 341us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309661.935799:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788309661.935865:0:15762:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c2f3f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788309661.935896:0:15762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:15762:1875178210557824:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788309661.935938:0:15762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:15762:1875178210557952:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788309661.935985:0:15762:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309661.936001:0:15762:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c2f3f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788309661.936087:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210557952 00000100:00100000:0.0:1788309661.936093:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210557952 00000100:00100000:0.0:1788309661.936133:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788309661.936142:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ee53e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1139bce-bc3d-41b1-9121-b11888b6dcf4+19:15762:x1875178210557952:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788309661.936339:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ee53e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1139bce-bc3d-41b1-9121-b11888b6dcf4+19:15762:x1875178210557952:12345-0@lo:503:mount.lustre.0 Request processed in 198us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309661.936347:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788309661.939583:0:15762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:15762:1875178210557952:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788309661.940429:0:15762:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788309661.940549:0:15762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:15762:1875178210558080:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788309661.940676:0:15762:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309661.940716:0:15762:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c2f3f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788309661.940840:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210558080 00000100:00100000:0.0:1788309661.940851:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210558080 00000100:00100000:0.0:1788309661.940912:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788309661.940924:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ee53dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1139bce-bc3d-41b1-9121-b11888b6dcf4+19:15762:x1875178210558080:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788309661.941215:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ee53dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1139bce-bc3d-41b1-9121-b11888b6dcf4+19:15762:x1875178210558080:12345-0@lo:502:mount.lustre.0 Request processed in 291us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309661.941224:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788309661.944766:0:15762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:15762:1875178210558080:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788309661.945197:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788309661.945320:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788309661.945362:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788309661.945423:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788309661.945485:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788309661.945539:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788309661.945579:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788309661.945617:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788309661.945679:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788309661.945722:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788309661.945759:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788309661.945810:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788309661.945848:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788309661.945883:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788309661.945932:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788309661.945969:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788309661.946005:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788309661.946081:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788309661.946121:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788309661.946155:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788309661.946224:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788309661.946260:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788309661.946338:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788309661.946390:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788309661.946444:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1788309661.946480:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1788309661.946531:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1788309661.946568:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1788309661.946607:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1788309661.946659:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1788309661.946695:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1788309661.946723:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1788309661.946753:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1788309661.946803:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1788309661.946840:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1788309661.946889:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1788309661.946944:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1788309661.946978:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1788309661.947027:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1788309661.947066:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1788309661.947139:0:15762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:15762:1875178210558208:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788309661.947254:0:15762:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309661.947369:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210558208 00000100:00100000:2.0:1788309661.947379:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210558208 00000100:00100000:3.0:1788309661.948587:0:15762:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c2f3f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788309661.951538:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788309661.951573:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ee53cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1139bce-bc3d-41b1-9121-b11888b6dcf4+19:15762:x1875178210558208:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788309661.952019:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ee53cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1139bce-bc3d-41b1-9121-b11888b6dcf4+19:15762:x1875178210558208:12345-0@lo:502:mount.lustre.0 Request processed in 462us (4763us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309661.952039:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788309661.952199:0:15762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:15762:1875178210558208:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788309661.952371:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1788309661.952391:0:15762:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1788309661.955856:0:15773:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788309661.955883:0:15773:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff97c7c34199b8) 00000020:00000080:3.0:1788309661.955913:0:15773:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1788309661.956014:0:15773:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97c8d93c7800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788309661.956019:0:15773:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97c8d93c7800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788309661.956022:0:15773:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97c8d93c7800 3 00010000:00080000:3.0:1788309661.956067:0:15773:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97c7c257e800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.155@tcp at head 00010000:00010000:3.0:1788309661.959723:0:15773:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1788309661.960032:0:15773:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788309661.960084:0:15773:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788309661.960104:0:15773:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x63a04852f46298f3 00000100:00080000:3.0:1788309661.960118:0:15773:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788309661.960127:0:15773:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff97c7c257e800 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:3.0:1788309661.960187:0:15773:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97c8fc577480 x1875178210558336/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788309661.960236:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc577480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3299:1875178210558336:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788309661.960356:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309661.960450:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210558336 00000100:00100000:3.0:1788309661.960458:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210558336 00000100:00100000:3.0:1788309661.960496:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788309661.960506:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc575f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3299:x1875178210558336:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788309661.960538:0:14363:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 424 last 0 00000020:00000080:3.0:1788309661.960583:0:14363:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x63a04852f46298fa 00000004:00100000:3.0:1788309661.960603:0:14363:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788309661.960646:0:14363:0:(import.c:65:import_set_state_nolock()) ffff97c8e07b6000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788309661.960707:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc575f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1875178210558336:12345-0@lo:38:llog_process_th.0 Request processed in 201us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309661.960716:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788309661.960762:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97c8fc577480 x1875178210558336/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788309671 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788309661.960773:0:3299:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788309661.960783:0:3299:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1788309661.960791:0:3299:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788309661.960796:0:3299:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788309661.960799:0:3299:0:(import.c:65:import_set_state_nolock()) ffff97c7c257e800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788309661.960805:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc577480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3299:1875178210558336:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1788309661.960823:0:15773:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788309661.960880:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788309661.960890:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788309661.960893:0:8:0:(import.c:65:import_set_state_nolock()) ffff97c8d693f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788309661.960898:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 422 00000100:00080000:3.0:1788309661.960902:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788309661.960906:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff97c8d693f800 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:3.0:1788309661.960920:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97c8fc577100 x1875178210558592/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788309661.960964:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788309661.960975:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc577480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210558464:0@lo:400:kworker.0 00000100:00100000:3.0:1788309661.961007:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309661.961034:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc576d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875178210558720:0@lo:400:kworker.0 00000100:00100000:3.0:1788309661.961055:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309661.961073:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788309661.961078:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc575180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875178210558848:0@lo:400:kworker.0 00000100:00100000:3.0:1788309661.961099:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309661.961130:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210558464 00000100:00100000:3.0:1788309661.961135:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210558464 00000100:00100000:3.0:1788309661.961182:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788309661.961189:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc574000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3300:x1875178210558464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309661.961227:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc574000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3300:x1875178210558464:12345-0@lo:400:kworker.0 Request processed in 39us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309661.961233:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788309661.961250:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210558720 00000100:00100000:3.0:1788309661.961253:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210558720 00000100:00100000:3.0:1788309661.961271:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210558848 00000100:00100000:3.0:1788309661.961273:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210558848 00000100:00100000:3.0:1788309661.961309:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788309661.961321:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc576300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875178210558720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309661.961369:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc576300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875178210558720:12345-0@lo:400:kworker.0 Request processed in 48us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309661.961376:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788309661.961388:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788309661.961394:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc575880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875178210558848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309661.961430:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc575880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875178210558848:12345-0@lo:400:kworker.0 Request processed in 36us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309661.961436:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1788309661.961456:0:14358:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788309661.961461:0:14358:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788309661.961486:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc577480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210558464:0@lo:400:kworker.0 00010000:00080000:3.0:1788309661.961509:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97c8fc575180 x1875178210558848/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309677 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788309661.961519:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc575180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875178210558848:0@lo:400:kworker.0 00010000:00080000:3.0:1788309661.961528:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97c8fc576d80 x1875178210558720/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309677 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788309661.961537:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc576d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875178210558720:0@lo:400:kworker.0 00000100:00100000:3.0:1788309661.961554:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc577100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875178210558592:0@lo:8:kworker.0 00000100:00100000:3.0:1788309661.961580:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309661.961609:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210558592 00000100:00100000:3.0:1788309661.961614:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210558592 00000100:00100000:3.0:1788309661.961632:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788309661.961637:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc576d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3299:x1875178210558592:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1788309661.961688:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc576d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3299:x1875178210558592:12345-0@lo:8:kworker.0 Request processed in 49us (107us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788309661.961694:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788309661.961720:0:3299:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788309661.961726:0:3299:0:(import.c:65:import_set_state_nolock()) ffff97c8d693f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788309661.961730:0:3299:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788309661.961733:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc577100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875178210558592:0@lo:8:kworker.0 00000040:00080000:3.0:1788309661.962300:0:15773:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1788309661.962358:0:15762:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1788309661.962395:0:15762:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788309661.962429:0:15762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8ecf2fa00/0x63a04852f46298de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f46298e5 expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309661.962442:0:15762:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff97c8ecf2fa00/0x63a04852f46298de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f46298e5 expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788309661.962507:0:15762:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788309661.962509:0:15762:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788309661.962511:0:15762:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788309661.962512:0:15762:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788309661.962514:0:15762:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788309661.962515:0:15762:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788309661.962517:0:15762:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788309661.962520:0:15762:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788309661.962522:0:15762:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788309661.962527:0:15762:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1788309661.962530:0:15762:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788309661.962531:0:15762:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788309661.962532:0:15762:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788309661.962534:0:15762:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788309661.962535:0:15762:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788309661.962536:0:15762:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788309661.962541:0:15762:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788309661.962542:0:15762:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788309661.962543:0:15762:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788309661.962561:0:15762:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788309661.962576:0:15762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc577100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:15762:1875178210558976:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788309661.962628:0:15762:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309661.962665:0:15762:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c2f3f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788309661.962690:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210558976 00000100:00100000:3.0:1788309661.962695:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210558976 00000100:00100000:3.0:1788309661.962729:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788309661.962736:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ee53f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1139bce-bc3d-41b1-9121-b11888b6dcf4+19:15762:x1875178210558976:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788309661.962765:0:14356:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788309661.962782:0:14356:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788309662.015771:0:14356:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788309662.015798:0:14356:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788309662.015919:0:14378:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788309662.015927:0:14378:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788309662.015964:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97c8e26d9c00/0x63a04852f4629901 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309662.016001:0:14378:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c8fc935800/0x63a04852f46297d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f46297cd expref: 19 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309662.016013:0:14378:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97c8e26d9c00/0x63a04852f4629901 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309662.016083:0:14378:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c8fc935800/0x63a04852f46297d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x63a04852f46297cd expref: 19 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309662.016106:0:14378:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97c8fc935800/0x63a04852f46297d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x63a04852f46297cd expref: 19 pid: 14355 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309662.016127:0:14378:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0c380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14378:1875178210559104:0@lo:104: 00000100:00100000:2.0:1788309662.016241:0:14378:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309662.016340:0:14378:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d691b840 going to sleep for 11 seconds 00000100:00100000:3.0:1788309662.016573:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210559104 00000100:00100000:3.0:1788309662.016587:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210559104 00000100:00100000:3.0:1788309662.016667:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788309662.016681:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8eff0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a1139bce-bc3d-41b1-9121-b11888b6dcf4+3:14378:x1875178210559104:12345-0@lo:104: 00010000:00010000:3.0:1788309662.016698:0:14346:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff97c8ecf2ea00/0x63a04852f46297cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x63a04852f46297d4 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309662.016775:0:14346:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788309662.016783:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8eff0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a1139bce-bc3d-41b1-9121-b11888b6dcf4+3:14378:x1875178210559104:12345-0@lo:104: Request processed in 105us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309662.016791:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1788309662.016820:0:14351:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788309662.016828:0:14351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff97c8ecf2ea00/0x63a04852f46297cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x63a04852f46297d4 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309662.016837:0:14351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8ecf2ea00 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:3.0:1788309662.016842:0:14351:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff97c8ecf2ea00/0x63a04852f46297cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x63a04852f46297d4 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309662.016878:0:14351:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff97c8ecf2ea00/0x63a04852f46297cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x63a04852f46297d4 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788309662.016886:0:14351:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff97c8ecf2ea00/0x63a04852f46297cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x63a04852f46297d4 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788309662.016892:0:14351:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788309662.016935:0:14351:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff97c8ecf2ea00/0x63a04852f46297cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f46297d4 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309662.016942:0:14351:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788309662.016971:0:14351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff97c8ecf2ea00/0x63a04852f46297cd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f46297d4 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309662.016980:0:14351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff97c8ecf2ea00/0x63a04852f46297cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f46297d4 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309662.017015:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309662.017017:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309662.017019:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788309662.017035:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc575180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a1139bce-bc3d-41b1-9121-b11888b6dcf4:3300:1875178210559232:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788309662.017069:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309662.017114:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210559232 00000100:00100000:3.0:1788309662.017117:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210559232 00010000:00010000:3.0:1788309662.017135:0:14349:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c8fc935800/0x63a04852f46297d4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63a04852f46297cd expref: 20 pid: 14355 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309662.017158:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788309662.017164:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc577480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1139bce-bc3d-41b1-9121-b11888b6dcf4+20:3300:x1875178210559232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788309662.017183:0:14349:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788309662.017189:0:14349:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c8fc935800/0x63a04852f46297d4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63a04852f46297cd expref: 20 pid: 14355 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309662.017201:0:14349:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c8fc935800/0x63a04852f46297d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x63a04852f46297cd expref: 20 pid: 14355 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309662.017222:0:14349:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97c8e26d9c00/0x63a04852f4629901 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309662.017232:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8e26d9c00/0x63a04852f4629901 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788309662.017247:0:14349:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008301366s 00010000:00010000:3.0:1788309662.017252:0:14349:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97c8e26d9c00/0x63a04852f4629901 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309662.017260:0:14349:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97c8e26d9c00/0x63a04852f4629901 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309662.017268:0:14349:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97c8e26d9c00/0x63a04852f4629901 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309662.017322:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97c8e26d9c00/0x63a04852f4629901 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309662.017330:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d9c00 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:3.0:1788309662.017335:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97c8e26d9c00/0x63a04852f4629901 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309662.017342:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97c8e26d9c00/0x63a04852f4629901 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309662.017503:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97c8e26d9c00/0x63a04852f4629901 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309662.017518:0:14349:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788309662.017555:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc577480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1139bce-bc3d-41b1-9121-b11888b6dcf4+20:3300:x1875178210559232:12345-0@lo:103:ldlm_bl.0 Request processed in 391us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309662.017563:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788309662.017630:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc575180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a1139bce-bc3d-41b1-9121-b11888b6dcf4:3300:1875178210559232:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788309662.017763:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c8fc935800/0x63a04852f46297d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x63a04852f46297cd expref: 19 pid: 14355 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309662.017778:0:14378:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0c380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14378:1875178210559104:0@lo:104: 00010000:00010000:2.0:1788309662.017794:0:14378:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97c8e26d9c00/0x63a04852f4629901 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309662.017805:0:14378:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97c8e26d9c00/0x63a04852f4629901 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309662.017821:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97c8e26d9c00/0x63a04852f4629901 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309662.017828:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c8e26d9c00/0x63a04852f4629901 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309662.027308:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ee53f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1139bce-bc3d-41b1-9121-b11888b6dcf4+18:15762:x1875178210558976:12345-0@lo:253:mount.lustre.0 Request processed in 64526us (64634us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309662.027334:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788309662.027494:0:15762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc577100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1139bce-bc3d-41b1-9121-b11888b6dcf4:15762:1875178210558976:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788309662.027518:0:15762:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788309662.027523:0:15762:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788309662.027525:0:15762:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788309662.027527:0:15762:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788309662.027529:0:15762:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788309662.027530:0:15762:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788309662.027531:0:15762:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788309662.027533:0:15762:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788309662.027536:0:15762:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788309662.027538:0:15762:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788309662.027560:0:15762:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788309662.032327:0:15762:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788309662.032494:0:15762:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788309662.032642:0:15762:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788309662.032971:0:15762:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788309662.033221:0:15762:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788309662.033500:0:15762:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788309662.034511:0:15762:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1788309662.136591:0:15762:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1788309662.136672:0:15762:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1788309662.136725:0:15762:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788309662.136894:0:15762:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.155@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788309662.136924:0:15762:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788309662.136970:0:15762:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1788309662.373904:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788309663.371956:0:6706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:3.0:1788309663.372095:0:6706:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1788309663.395167:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788309663.968516:0:14360:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788309663.968527:0:14360:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff97c8ffb11000 from 8 10000000:01000000:2.0:1788309663.968535:0:14360:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788309663.968606:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8e00/0x63a04852f4629908 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309663.968621:0:14360:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8e00/0x63a04852f4629908 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309663.968636:0:14360:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8e00/0x63a04852f4629908 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309663.968669:0:14360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14360:1875178210559360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788309663.968783:0:14360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309663.968867:0:14360:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8e265d300 going to sleep for 11 seconds 00000100:00100000:3.0:1788309663.968955:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210559360 00000100:00100000:3.0:1788309663.968969:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210559360 00000100:00100000:3.0:1788309663.969232:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788309663.969247:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ee53d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1139bce-bc3d-41b1-9121-b11888b6dcf4+18:14360:x1875178210559360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788309663.969267:0:14355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309663.969322:0:14355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c8c153be00/0x63a04852f462990f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x63a04852f4629908 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309663.969354:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8c153be00/0x63a04852f462990f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63a04852f4629908 expref: 19 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309663.969367:0:14355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c8c153be00/0x63a04852f462990f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f4629908 expref: 19 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309663.969380:0:14355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8c153be00, rc 0) 00000100:00100000:3.0:1788309663.969449:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ee53d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1139bce-bc3d-41b1-9121-b11888b6dcf4+19:14360:x1875178210559360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 205us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309663.969457:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788309663.970190:0:14360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14360:1875178210559360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788309663.970216:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8e00/0x63a04852f4629908 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f462990f expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309663.970240:0:14360:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8e00/0x63a04852f4629908 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x63a04852f462990f expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309663.970329:0:14360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14360:1875178210559488:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788309663.970381:0:14360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309663.973345:0:14360:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8e265d300 going to sleep for 11 seconds 00000100:00100000:0.0:1788309663.973493:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210559488 00000100:00100000:0.0:1788309663.973508:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210559488 00000100:00100000:0.0:1788309663.973569:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788309663.973582:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ee53ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1139bce-bc3d-41b1-9121-b11888b6dcf4+19:14360:x1875178210559488:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788309663.973627:0:14357:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788309663.973653:0:14357:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788309663.973657:0:14357:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1788309663.973818:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ee53ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1139bce-bc3d-41b1-9121-b11888b6dcf4+19:14360:x1875178210559488:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 238us (3435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309663.973827:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788309663.977612:0:14360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14360:1875178210559488:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788309663.977722:0:14360:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788309663.977734:0:14360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8e00/0x63a04852f4629908 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f462990f expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309663.977746:0:14360:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8e00/0x63a04852f4629908 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f462990f expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309664.425109:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788309664.739590:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecb41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210559616:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788309664.739692:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309664.739795:0:15048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210559616 00000100:00100000:1.0:1788309664.739805:0:15048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210559616 00000100:00100000:1.0:1788309664.739878:0:15048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788309664.739889:0:15048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecb40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875178210559616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788309664.739934:0:15048:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788309664.739983:0:15048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecb40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875178210559616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309664.739990:0:15048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788309664.740013:0:14358:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788309664.740076:0:3301:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1788309664.740105:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecb41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210559616:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788309665.444746:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309666.469684:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788309666.977211:0:14394:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:3.0:1788309667.296551:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788309667.296563:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788309667.296568:0:8:0:(import.c:65:import_set_state_nolock()) ffff97c8d693f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788309667.296589:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff97c8d693f800 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:3.0:1788309667.296620:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97c8fc574a80 x1875178210560000/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788309667.296658:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc577100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a1139bce-bc3d-41b1-9121-b11888b6dcf4:3302:1875178210559744:0@lo:400:kworker.0 00000100:00100000:3.0:1788309667.296699:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc574a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875178210560000:0@lo:8:kworker.0 00000100:00100000:2.0:1788309667.296777:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc575180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210559872:0@lo:400:kworker.0 00000100:00100000:3.0:1788309667.311062:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309667.311391:0:15047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210560000 00000100:00100000:3.0:1788309667.311403:0:15047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210560000 00000100:00100000:3.0:1788309667.311449:0:15047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788309667.311459:0:15047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc91ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3299:x1875178210560000:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788309667.311501:0:15047:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 430 last 0 00000020:00000080:3.0:1788309667.311542:0:15047:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x63a04852f4629916 00002000:00100000:3.0:1788309667.311562:0:15047:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff97c7c257f000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211392d ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788309667.311567:0:15047:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1788309667.311571:0:15047:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788309667.312314:0:15047:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788309667.312347:0:15047:0:(import.c:65:import_set_state_nolock()) ffff97c7c2579800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788309667.312474:0:15047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc91ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3299:x1875178210560000:12345-0@lo:8:kworker.0 Request processed in 1014us (1420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309667.312484:0:15047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788309667.312566:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8fc574a80 x1875178210560000/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788309692 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788309667.312588:0:3299:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788309667.312613:0:3299:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788309667.312620:0:3299:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788309667.312623:0:3299:0:(import.c:65:import_set_state_nolock()) ffff97c8d693f800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788309667.312649:0:3299:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788309667.312655:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc574a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875178210560000:0@lo:8:kworker.0 00000004:00080000:3.0:1788309667.312720:0:14387:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:3.0:1788309667.312741:0:14387:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc91f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14387:1875178210560640:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788309667.312782:0:14387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309667.312806:0:14387:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8f51d7000 going to sleep for 11 seconds 00000100:00100000:3.0:1788309667.312822:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210560640 00000100:00100000:3.0:1788309667.312827:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210560640 00000100:00100000:3.0:1788309667.312877:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788309667.312885:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc91ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14387:x1875178210560640:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788309667.318225:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788309667.318321:0:14358:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788309667.318354:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc91df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875178210560128:0@lo:400:kworker.0 00000100:00100000:1.0:1788309667.318459:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309667.318498:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788309667.318506:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc91fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875178210560256:0@lo:400:kworker.0 00000100:00100000:1.0:1788309667.318533:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309667.318785:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210559744 00000100:00100000:1.0:1788309667.318798:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210559744 00000100:00100000:1.0:1788309667.318860:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788309667.318871:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ee53c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1139bce-bc3d-41b1-9121-b11888b6dcf4+19:3302:x1875178210559744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309667.318934:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ee53c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1139bce-bc3d-41b1-9121-b11888b6dcf4+19:3302:x1875178210559744:12345-0@lo:400:kworker.0 Request processed in 64us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309667.318943:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788309667.318982:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210560128 00000100:00100000:1.0:1788309667.318986:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210560128 00000100:00100000:1.0:1788309667.319011:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210560256 00000100:00100000:1.0:1788309667.319014:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210560256 00000100:00100000:1.0:1788309667.328598:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788309667.328624:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecb41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875178210560128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309667.328756:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecb41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875178210560128:12345-0@lo:400:kworker.0 Request processed in 143us (10296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309667.328765:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788309667.328804:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788309667.328812:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecb42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875178210560256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309667.328844:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecb42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875178210560256:12345-0@lo:400:kworker.0 Request processed in 34us (10311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309667.328850:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1788309667.329830:0:14358:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788309667.329892:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8fc91fb80 x1875178210560256/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309683 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788309667.329910:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc91fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875178210560256:0@lo:400:kworker.0 00010000:00080000:1.0:1788309667.329925:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8fc91df80 x1875178210560128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309683 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788309667.329934:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc91df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875178210560128:0@lo:400:kworker.0 00000100:00100000:1.0:1788309667.330170:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc577100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a1139bce-bc3d-41b1-9121-b11888b6dcf4:3302:1875178210559744:0@lo:400:kworker.0 00000100:00100000:1.0:1788309667.330192:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc91d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875178210560384:0@lo:400:kworker.0 00000100:00100000:1.0:1788309667.330257:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309667.330308:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210560384 00000100:00100000:1.0:1788309667.330315:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210560384 00000100:00100000:1.0:1788309667.330361:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788309667.330404:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecb40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875178210560384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309667.330448:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecb40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875178210560384:12345-0@lo:400:kworker.0 Request processed in 80us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309667.330454:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1788309667.330471:0:14358:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788309667.330487:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8fc91d880 x1875178210560384/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309683 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788309667.330511:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc91d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875178210560384:0@lo:400:kworker.0 00000100:00100000:1.0:1788309667.330523:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788309667.330530:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc91d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875178210560512:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788309667.330563:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309667.330588:0:15048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210560512 00000100:00100000:1.0:1788309667.330591:0:15048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210560512 00000100:00100000:1.0:1788309667.330621:0:15048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788309667.330628:0:15048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecb42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1875178210560512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788309667.330661:0:15048:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788309667.330691:0:15048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecb42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1875178210560512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309667.330697:0:15048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788309667.330721:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8fc91d180 x1875178210560512/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788309683 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788309667.330736:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc91d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875178210560512:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788309667.334004:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309667.335234:0:15047:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788309667.335251:0:15047:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1788309667.335512:0:15047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210559872 00000100:00100000:3.0:1788309667.335526:0:15047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210559872 00000100:00080000:0.0:1788309667.337725:0:14358:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788309667.337977:0:15047:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788309667.338010:0:15047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788309667.338031:0:15047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8eff0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210559872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309667.338181:0:15047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8eff0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210559872:12345-0@lo:400:kworker.0 Request processed in 160us (4187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309667.338189:0:15047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788309667.340215:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc575180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210559872:0@lo:400:kworker.0 00000004:00080000:1.0:1788309667.340521:0:14386:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788309667.345264:0:14386:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 430095982318ns, next at 0ns, rc = 0 00002000:00080000:3.0:1788309667.348747:0:15044:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1788309667.348765:0:15044:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1788309667.348773:0:15044:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:3.0:1788309667.357848:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788309667.357879:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0a92bcf/0x63a04852f462991d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.357902:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=430s v=(0 0) 00010000:00010000:3.0:1788309667.357908:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788309667.357916:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0a92bcf/0x63a04852f462991d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.357941:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c0a92bcf/0x63a04852f462991d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.357955:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0a92bcf/0x63a04852f462991d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.357964:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c0a92bcf/0x63a04852f462991d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.357994:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788309667.358017:0:14351:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788309667.358025:0:14351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c0a92bcf/0x63a04852f462991d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.358034:0:14351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8c153a200 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:3.0:1788309667.358040:0:14351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0a92bcf/0x63a04852f462991d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.358051:0:14351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0a92bcf/0x63a04852f462991d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.358080:0:14351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c0a92bcf/0x63a04852f462991d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.358088:0:14351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0a92bcf/0x63a04852f462991d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.358111:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309667.358113:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309667.358115:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788309667.358716:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788309667.359312:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd8c1685/0x63a04852f4629924 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.359324:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=430s v=(0 0) 00010000:00010000:3.0:1788309667.359328:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788309667.359332:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd8c1685/0x63a04852f4629924 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.359342:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd8c1685/0x63a04852f4629924 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.359349:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd8c1685/0x63a04852f4629924 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.359354:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd8c1685/0x63a04852f4629924 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.359547:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788309667.359567:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788309667.359573:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd8c1685/0x63a04852f4629924 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.359581:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8c153ba00 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:3.0:1788309667.359585:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd8c1685/0x63a04852f4629924 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.359595:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd8c1685/0x63a04852f4629924 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.359614:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd8c1685/0x63a04852f4629924 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.359621:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd8c1685/0x63a04852f4629924 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.359647:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309667.359649:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309667.359651:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788309667.360245:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788309667.360252:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eaffa74f/0x63a04852f462992b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.360260:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=430s v=(0 0) 00010000:00010000:3.0:1788309667.360267:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788309667.360271:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eaffa74f/0x63a04852f462992b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.360304:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eaffa74f/0x63a04852f462992b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.360311:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eaffa74f/0x63a04852f462992b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.360317:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eaffa74f/0x63a04852f462992b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.360327:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788309667.360335:0:14351:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788309667.360339:0:14351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eaffa74f/0x63a04852f462992b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.360345:0:14351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8c153ac00 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:3.0:1788309667.360348:0:14351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eaffa74f/0x63a04852f462992b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.360352:0:14351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eaffa74f/0x63a04852f462992b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.360359:0:14351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eaffa74f/0x63a04852f462992b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.360387:0:14351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eaffa74f/0x63a04852f462992b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.360405:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309667.360407:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309667.360409:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788309667.360843:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788309667.360850:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076b14d99/0x63a04852f4629932 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.360859:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=430s v=(0 0) 00010000:00010000:3.0:1788309667.360862:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788309667.360866:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076b14d99/0x63a04852f4629932 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.360876:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000076b14d99/0x63a04852f4629932 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.360885:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076b14d99/0x63a04852f4629932 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.360893:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000076b14d99/0x63a04852f4629932 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.360910:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788309667.360920:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788309667.360927:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000076b14d99/0x63a04852f4629932 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.360933:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8c153a000 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:3.0:1788309667.360936:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000076b14d99/0x63a04852f4629932 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.360941:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000076b14d99/0x63a04852f4629932 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.360950:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000076b14d99/0x63a04852f4629932 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.360955:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000076b14d99/0x63a04852f4629932 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.360967:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309667.360969:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309667.360970:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788309667.363840:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788309667.363860:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb6a6b8e/0x63a04852f4629939 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.363883:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=430s v=(0 0) 00010000:00010000:3.0:1788309667.363889:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788309667.363897:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb6a6b8e/0x63a04852f4629939 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.363933:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eb6a6b8e/0x63a04852f4629939 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.363945:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb6a6b8e/0x63a04852f4629939 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.363954:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eb6a6b8e/0x63a04852f4629939 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.363981:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788309667.363997:0:14351:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788309667.364004:0:14351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eb6a6b8e/0x63a04852f4629939 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.364012:0:14351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8c153a400 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:3.0:1788309667.364017:0:14351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb6a6b8e/0x63a04852f4629939 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.364028:0:14351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb6a6b8e/0x63a04852f4629939 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.364049:0:14351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eb6a6b8e/0x63a04852f4629939 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.364057:0:14351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb6a6b8e/0x63a04852f4629939 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.364088:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309667.364090:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309667.364092:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788309667.364895:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788309667.364905:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069500209/0x63a04852f4629940 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.364918:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=430s v=(0 0) 00010000:00010000:3.0:1788309667.364922:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788309667.364928:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069500209/0x63a04852f4629940 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.364938:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069500209/0x63a04852f4629940 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.364945:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069500209/0x63a04852f4629940 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.364950:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069500209/0x63a04852f4629940 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.364965:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788309667.364975:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788309667.364979:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069500209/0x63a04852f4629940 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.364991:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c9021e5600 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:3.0:1788309667.364994:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069500209/0x63a04852f4629940 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.365000:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069500209/0x63a04852f4629940 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.365008:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069500209/0x63a04852f4629940 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.365012:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069500209/0x63a04852f4629940 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.365026:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309667.365027:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309667.365028:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788309667.365455:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788309667.365462:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6d7f561/0x63a04852f4629947 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.365470:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=430s v=(0 0) 00010000:00010000:3.0:1788309667.365473:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788309667.365475:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6d7f561/0x63a04852f4629947 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.365483:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6d7f561/0x63a04852f4629947 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.365494:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6d7f561/0x63a04852f4629947 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.365499:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d6d7f561/0x63a04852f4629947 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.365513:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788309667.365522:0:14351:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788309667.365527:0:14351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d6d7f561/0x63a04852f4629947 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.365534:0:14351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c9021e4c00 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:3.0:1788309667.365537:0:14351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6d7f561/0x63a04852f4629947 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.365545:0:14351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6d7f561/0x63a04852f4629947 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.365555:0:14351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d6d7f561/0x63a04852f4629947 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.365561:0:14351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6d7f561/0x63a04852f4629947 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.365572:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309667.365577:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309667.365579:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788309667.365924:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788309667.365928:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080732a0d/0x63a04852f462994e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.365934:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=430s v=(0 0) 00010000:00010000:3.0:1788309667.365936:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788309667.365940:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080732a0d/0x63a04852f462994e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.365946:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080732a0d/0x63a04852f462994e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.365952:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080732a0d/0x63a04852f462994e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.365956:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080732a0d/0x63a04852f462994e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.365966:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788309667.365971:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788309667.365973:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080732a0d/0x63a04852f462994e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.365977:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c9021e5c00 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:3.0:1788309667.365979:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080732a0d/0x63a04852f462994e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.365993:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080732a0d/0x63a04852f462994e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.366000:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080732a0d/0x63a04852f462994e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.366005:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080732a0d/0x63a04852f462994e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.366014:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309667.366015:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309667.366016:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788309667.366491:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788309667.366497:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f291674e/0x63a04852f4629955 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.366550:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=430s v=(0 0) 00010000:00010000:3.0:1788309667.366553:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788309667.366557:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f291674e/0x63a04852f4629955 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.366568:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f291674e/0x63a04852f4629955 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.366653:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f291674e/0x63a04852f4629955 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.366664:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f291674e/0x63a04852f4629955 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.366677:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788309667.366686:0:14351:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788309667.366690:0:14351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f291674e/0x63a04852f4629955 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.366695:0:14351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c9021e4200 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:3.0:1788309667.366697:0:14351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f291674e/0x63a04852f4629955 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.366702:0:14351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f291674e/0x63a04852f4629955 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.366709:0:14351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f291674e/0x63a04852f4629955 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.366714:0:14351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f291674e/0x63a04852f4629955 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.366727:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309667.366729:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309667.366731:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788309667.367092:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788309667.367102:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b25f4a8/0x63a04852f462995c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.367108:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=430s v=(0 0) 00010000:00010000:3.0:1788309667.367110:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788309667.367113:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b25f4a8/0x63a04852f462995c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.367119:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002b25f4a8/0x63a04852f462995c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.367124:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b25f4a8/0x63a04852f462995c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.367129:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002b25f4a8/0x63a04852f462995c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.367138:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788309667.367144:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788309667.367146:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002b25f4a8/0x63a04852f462995c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.367150:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c9021e5a00 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:3.0:1788309667.367153:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002b25f4a8/0x63a04852f462995c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.367157:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002b25f4a8/0x63a04852f462995c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.367169:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002b25f4a8/0x63a04852f462995c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.367174:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002b25f4a8/0x63a04852f462995c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.367183:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309667.367184:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309667.367185:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788309667.367844:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788309667.367852:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7a7ee8c/0x63a04852f4629963 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.367863:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=430s v=(0 0) 00010000:00010000:3.0:1788309667.367867:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788309667.367872:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7a7ee8c/0x63a04852f4629963 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.367881:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a7a7ee8c/0x63a04852f4629963 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.367890:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7a7ee8c/0x63a04852f4629963 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.367899:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a7a7ee8c/0x63a04852f4629963 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.367929:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788309667.367941:0:14351:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788309667.367946:0:14351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a7a7ee8c/0x63a04852f4629963 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.367953:0:14351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c9021e4600 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:3.0:1788309667.367957:0:14351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7a7ee8c/0x63a04852f4629963 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.367966:0:14351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7a7ee8c/0x63a04852f4629963 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.367980:0:14351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a7a7ee8c/0x63a04852f4629963 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.367987:0:14351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a7a7ee8c/0x63a04852f4629963 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.368003:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309667.368004:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309667.368005:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788309667.371148:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788309667.371166:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4e23393/0x63a04852f462996a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.371193:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=430s v=(0 0) 00010000:00010000:3.0:1788309667.371208:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788309667.371216:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4e23393/0x63a04852f462996a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.371234:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e4e23393/0x63a04852f462996a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.371248:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4e23393/0x63a04852f462996a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.371257:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e4e23393/0x63a04852f462996a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.371319:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788309667.371344:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788309667.371351:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e4e23393/0x63a04852f462996a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.371361:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8d73ee800 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:3.0:1788309667.371380:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4e23393/0x63a04852f462996a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.371391:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4e23393/0x63a04852f462996a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.371414:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e4e23393/0x63a04852f462996a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.371434:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e4e23393/0x63a04852f462996a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.371462:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309667.371465:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309667.371468:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788309667.372040:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788309667.372049:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002188072/0x63a04852f4629971 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.372061:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=430s v=(0 0) 00010000:00010000:3.0:1788309667.372066:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788309667.372071:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002188072/0x63a04852f4629971 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.372083:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002188072/0x63a04852f4629971 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.372092:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002188072/0x63a04852f4629971 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.372101:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002188072/0x63a04852f4629971 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.372123:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788309667.372135:0:14351:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788309667.372148:0:14351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002188072/0x63a04852f4629971 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.372157:0:14351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8d73efc00 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:3.0:1788309667.372161:0:14351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002188072/0x63a04852f4629971 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.372170:0:14351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002188072/0x63a04852f4629971 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.372185:0:14351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002188072/0x63a04852f4629971 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.372193:0:14351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002188072/0x63a04852f4629971 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.372208:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309667.372210:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309667.372212:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788309667.373106:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788309667.373116:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006288a78/0x63a04852f4629978 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.373129:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=430s v=(0 0) 00010000:00010000:3.0:1788309667.373134:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788309667.373139:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006288a78/0x63a04852f4629978 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.373166:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000006288a78/0x63a04852f4629978 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.373176:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006288a78/0x63a04852f4629978 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.373184:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000006288a78/0x63a04852f4629978 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.373204:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788309667.373216:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788309667.373221:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000006288a78/0x63a04852f4629978 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.373229:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8d73efa00 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:3.0:1788309667.373233:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000006288a78/0x63a04852f4629978 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.373242:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000006288a78/0x63a04852f4629978 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.373256:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000006288a78/0x63a04852f4629978 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.373265:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006288a78/0x63a04852f4629978 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.373322:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309667.373324:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309667.373327:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788309667.374027:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788309667.374037:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002b18e15/0x63a04852f462997f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.374048:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=430s v=(0 0) 00010000:00010000:3.0:1788309667.374053:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788309667.374058:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002b18e15/0x63a04852f462997f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.374069:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002b18e15/0x63a04852f462997f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.374079:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002b18e15/0x63a04852f462997f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.374088:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002b18e15/0x63a04852f462997f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.374106:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788309667.374118:0:14351:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788309667.374123:0:14351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002b18e15/0x63a04852f462997f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.374144:0:14351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8d73ef600 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:3.0:1788309667.374149:0:14351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002b18e15/0x63a04852f462997f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.374159:0:14351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002b18e15/0x63a04852f462997f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.374173:0:14351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002b18e15/0x63a04852f462997f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.374181:0:14351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002b18e15/0x63a04852f462997f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.374198:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309667.374200:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309667.374202:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788309667.374809:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788309667.374819:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9e83bb3/0x63a04852f4629986 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.374830:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=430s v=(0 0) 00010000:00010000:3.0:1788309667.374834:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788309667.374839:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9e83bb3/0x63a04852f4629986 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.374850:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9e83bb3/0x63a04852f4629986 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.374867:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9e83bb3/0x63a04852f4629986 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.374875:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9e83bb3/0x63a04852f4629986 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.374895:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788309667.374906:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788309667.374910:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9e83bb3/0x63a04852f4629986 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.374918:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8d73ee600 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:3.0:1788309667.374921:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9e83bb3/0x63a04852f4629986 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.374931:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9e83bb3/0x63a04852f4629986 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.374944:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9e83bb3/0x63a04852f4629986 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.374952:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9e83bb3/0x63a04852f4629986 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.374968:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309667.374975:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309667.374977:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788309667.375442:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788309667.375449:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001183343d/0x63a04852f462998d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.375458:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=430s v=(0 0) 00010000:00010000:3.0:1788309667.375461:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788309667.375466:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001183343d/0x63a04852f462998d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.375476:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001183343d/0x63a04852f462998d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.375484:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001183343d/0x63a04852f462998d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.375492:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001183343d/0x63a04852f462998d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.375509:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788309667.375518:0:14351:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788309667.375523:0:14351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001183343d/0x63a04852f462998d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.375529:0:14351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8d73ee200 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:3.0:1788309667.375532:0:14351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001183343d/0x63a04852f462998d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.375622:0:14351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001183343d/0x63a04852f462998d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.375636:0:14351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001183343d/0x63a04852f462998d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.375642:0:14351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001183343d/0x63a04852f462998d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.375658:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309667.375660:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309667.375662:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788309667.376122:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788309667.376129:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003bd6d1a2/0x63a04852f4629994 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.376139:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=430s v=(0 0) 00010000:00010000:3.0:1788309667.376143:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788309667.376147:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003bd6d1a2/0x63a04852f4629994 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.376158:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003bd6d1a2/0x63a04852f4629994 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.376168:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003bd6d1a2/0x63a04852f4629994 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.376182:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003bd6d1a2/0x63a04852f4629994 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.376199:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788309667.376209:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788309667.376214:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003bd6d1a2/0x63a04852f4629994 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.376222:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8d73eec00 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:3.0:1788309667.376225:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003bd6d1a2/0x63a04852f4629994 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.376235:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003bd6d1a2/0x63a04852f4629994 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.376247:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003bd6d1a2/0x63a04852f4629994 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.376255:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003bd6d1a2/0x63a04852f4629994 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.376271:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309667.376272:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309667.376301:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788309667.376853:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788309667.376870:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003cb2256d/0x63a04852f462999b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.376881:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=430s v=(0 0) 00010000:00010000:3.0:1788309667.376884:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788309667.376890:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003cb2256d/0x63a04852f462999b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.376902:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003cb2256d/0x63a04852f462999b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.376912:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003cb2256d/0x63a04852f462999b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.376920:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003cb2256d/0x63a04852f462999b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.376941:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788309667.376953:0:14351:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788309667.376959:0:14351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003cb2256d/0x63a04852f462999b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.376967:0:14351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8d73eea00 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:3.0:1788309667.376970:0:14351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003cb2256d/0x63a04852f462999b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.376979:0:14351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003cb2256d/0x63a04852f462999b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.376998:0:14351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003cb2256d/0x63a04852f462999b lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.377006:0:14351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003cb2256d/0x63a04852f462999b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.377024:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309667.377026:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309667.377028:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788309667.377478:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788309667.377484:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009cc074bf/0x63a04852f46299a2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.377493:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=430s v=(0 0) 00010000:00010000:3.0:1788309667.377496:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788309667.377500:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009cc074bf/0x63a04852f46299a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.377510:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009cc074bf/0x63a04852f46299a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.377519:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009cc074bf/0x63a04852f46299a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.377527:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009cc074bf/0x63a04852f46299a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.377632:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788309667.377644:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788309667.377648:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009cc074bf/0x63a04852f46299a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.377655:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8d73efe00 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:3.0:1788309667.377659:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009cc074bf/0x63a04852f46299a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.377667:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009cc074bf/0x63a04852f46299a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.377679:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009cc074bf/0x63a04852f46299a2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.377687:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009cc074bf/0x63a04852f46299a2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.377703:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309667.377704:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309667.377707:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788309667.378142:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788309667.378150:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085a45e72/0x63a04852f46299a9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.378160:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=430s v=(0 0) 00010000:00010000:3.0:1788309667.378168:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788309667.378172:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085a45e72/0x63a04852f46299a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.378184:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085a45e72/0x63a04852f46299a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.378193:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085a45e72/0x63a04852f46299a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.378202:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000085a45e72/0x63a04852f46299a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.378216:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788309667.378226:0:14351:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788309667.378230:0:14351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000085a45e72/0x63a04852f46299a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.378237:0:14351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8d73ef200 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:3.0:1788309667.378241:0:14351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000085a45e72/0x63a04852f46299a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.378248:0:14351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000085a45e72/0x63a04852f46299a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.378259:0:14351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000085a45e72/0x63a04852f46299a9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.378305:0:14351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085a45e72/0x63a04852f46299a9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.378321:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309667.378322:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309667.378324:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788309667.378886:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788309667.378894:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004aca722b/0x63a04852f46299b0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.378906:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=430s v=(0 0) 00010000:00010000:3.0:1788309667.378910:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788309667.378915:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004aca722b/0x63a04852f46299b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.378926:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004aca722b/0x63a04852f46299b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.378935:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004aca722b/0x63a04852f46299b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.378943:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004aca722b/0x63a04852f46299b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.378962:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788309667.378971:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788309667.378980:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004aca722b/0x63a04852f46299b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.378988:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8d73ef000 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:3.0:1788309667.378991:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004aca722b/0x63a04852f46299b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.378998:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004aca722b/0x63a04852f46299b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.379008:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004aca722b/0x63a04852f46299b0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.379012:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004aca722b/0x63a04852f46299b0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.379024:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309667.379025:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309667.379026:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788309667.379395:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788309667.379401:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ba51ed4/0x63a04852f46299b7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.379410:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=430s v=(0 0) 00010000:00010000:3.0:1788309667.379413:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788309667.379418:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ba51ed4/0x63a04852f46299b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.379439:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ba51ed4/0x63a04852f46299b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.379448:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ba51ed4/0x63a04852f46299b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.379454:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002ba51ed4/0x63a04852f46299b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.379468:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788309667.379478:0:14351:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788309667.379482:0:14351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002ba51ed4/0x63a04852f46299b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.379489:0:14351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8d73ef400 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:3.0:1788309667.379492:0:14351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002ba51ed4/0x63a04852f46299b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.379499:0:14351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002ba51ed4/0x63a04852f46299b7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.379511:0:14351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002ba51ed4/0x63a04852f46299b7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.379518:0:14351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ba51ed4/0x63a04852f46299b7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.379541:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309667.379543:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309667.379545:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788309667.380050:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788309667.380058:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7f42a66/0x63a04852f46299be lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.380071:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=430s v=(0 0) 00010000:00010000:3.0:1788309667.380074:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788309667.380078:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7f42a66/0x63a04852f46299be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.380087:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7f42a66/0x63a04852f46299be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.380095:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7f42a66/0x63a04852f46299be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.380102:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e7f42a66/0x63a04852f46299be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.380118:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788309667.380127:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788309667.380131:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e7f42a66/0x63a04852f46299be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.380148:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8d73ee400 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:3.0:1788309667.380151:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7f42a66/0x63a04852f46299be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.380160:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7f42a66/0x63a04852f46299be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.380172:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e7f42a66/0x63a04852f46299be lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.380179:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7f42a66/0x63a04852f46299be lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.380195:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309667.380196:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309667.380198:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788309667.380818:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788309667.380826:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ff3ebed/0x63a04852f46299c5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.380838:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=430s v=(0 0) 00010000:00010000:3.0:1788309667.380841:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788309667.380846:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ff3ebed/0x63a04852f46299c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.380857:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ff3ebed/0x63a04852f46299c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.380872:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ff3ebed/0x63a04852f46299c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.380879:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004ff3ebed/0x63a04852f46299c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.380898:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788309667.380911:0:14351:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788309667.380918:0:14351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004ff3ebed/0x63a04852f46299c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.380924:0:14351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8d73ef800 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:3.0:1788309667.380928:0:14351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004ff3ebed/0x63a04852f46299c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.380937:0:14351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004ff3ebed/0x63a04852f46299c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.380949:0:14351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004ff3ebed/0x63a04852f46299c5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.380956:0:14351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ff3ebed/0x63a04852f46299c5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.380972:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309667.380978:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309667.380980:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788309667.381448:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788309667.381456:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3ab9b77/0x63a04852f46299cc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.381465:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=430s v=(0 0) 00010000:00010000:3.0:1788309667.381469:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788309667.381473:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3ab9b77/0x63a04852f46299cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.381483:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3ab9b77/0x63a04852f46299cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.381492:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3ab9b77/0x63a04852f46299cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.381500:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3ab9b77/0x63a04852f46299cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.381517:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788309667.381527:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788309667.381531:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3ab9b77/0x63a04852f46299cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.381538:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8d73eee00 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:3.0:1788309667.381541:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3ab9b77/0x63a04852f46299cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.381935:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3ab9b77/0x63a04852f46299cc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.381950:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3ab9b77/0x63a04852f46299cc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.381957:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3ab9b77/0x63a04852f46299cc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.381979:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309667.381981:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309667.381983:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788309667.382535:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788309667.382542:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000777bc038/0x63a04852f46299d3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.382553:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=430s v=(0 0) 00010000:00010000:3.0:1788309667.382557:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788309667.382562:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000777bc038/0x63a04852f46299d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.382572:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000777bc038/0x63a04852f46299d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.382651:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000777bc038/0x63a04852f46299d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.382669:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000777bc038/0x63a04852f46299d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.382692:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788309667.382703:0:14351:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788309667.382708:0:14351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000777bc038/0x63a04852f46299d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.382716:0:14351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8c0031000 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:3.0:1788309667.382720:0:14351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000777bc038/0x63a04852f46299d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.382729:0:14351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000777bc038/0x63a04852f46299d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.382741:0:14351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000777bc038/0x63a04852f46299d3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.382749:0:14351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000777bc038/0x63a04852f46299d3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309667.382764:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309667.382766:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309667.382767:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1788309667.382962:0:15044:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:3.0:1788309667.383095:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc91ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14387:x1875178210560640:12345-0@lo:5:osp-pre-1-0.0 Request processed in 70205us (70306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309667.383115:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788309667.383193:0:14387:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc91f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14387:1875178210560640:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788309667.383216:0:14387:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:3.0:1788309667.383307:0:14387:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc91f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14387:1875178210560768:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788309667.383354:0:14387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309667.383407:0:14387:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8f51d7000 going to sleep for 11 seconds 00000100:00100000:3.0:1788309667.383430:0:15047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210560768 00000100:00100000:3.0:1788309667.383437:0:15047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210560768 00000100:00100000:3.0:1788309667.383484:0:15047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788309667.383494:0:15047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc91e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14387:x1875178210560768:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788309667.383549:0:15047:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:3.0:1788309667.389941:0:15047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc91e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14387:x1875178210560768:12345-0@lo:5:osp-pre-1-0.0 Request processed in 6435us (6574us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788309667.389959:0:15047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788309667.390049:0:14387:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc91f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14387:1875178210560768:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788309667.390072:0:14387:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000001:00100000:0.0:1788309667.452737:0:7639:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000004:00080000:2.0:1788309667.458030:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:0.0:1788309667.490687:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309668.512870:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309669.538580:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788309669.867904:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecb41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210560896:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788309669.868031:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309669.870498:0:15048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210560896 00000100:00100000:3.0:1788309669.870522:0:15048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210560896 00000100:00080000:2.0:1788309669.870604:0:14358:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788309669.870634:0:15048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788309669.870650:0:15048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8eff0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875178210560896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788309669.870709:0:15048:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788309669.870832:0:15048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8eff0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875178210560896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 186us (2801us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309669.870860:0:15048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788309669.870987:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecb41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210560896:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788309670.563751:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788309670.597558:0:16121:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg255-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788309671.597716:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788309672.417420:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a1139bce-bc3d-41b1-9121-b11888b6dcf4:3301:1875178210561024:0@lo:400:kworker.0 00000100:00100000:2.0:1788309672.417516:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309672.417575:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875178210561536:0@lo:400:kworker.0 00000100:00100000:2.0:1788309672.417603:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309672.417635:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788309672.417641:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875178210561408:0@lo:400:kworker.0 00000100:00100000:2.0:1788309672.418816:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309672.418872:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210561280:0@lo:400:kworker.0 00000100:00100000:2.0:1788309672.419318:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309672.419361:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788309672.419370:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210561152:0@lo:400:kworker.0 00000100:00100000:2.0:1788309672.419406:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309672.419425:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8eff0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875178210561664:0@lo:400:kworker.0 00000100:00100000:2.0:1788309672.419454:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309672.419516:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210561024 00000100:00100000:2.0:1788309672.419526:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210561024 00000100:00100000:2.0:1788309672.419588:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788309672.419600:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ee53e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1139bce-bc3d-41b1-9121-b11888b6dcf4+19:3301:x1875178210561024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309672.419667:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ee53e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1139bce-bc3d-41b1-9121-b11888b6dcf4+19:3301:x1875178210561024:12345-0@lo:400:kworker.0 Request processed in 67us (2150us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309672.424400:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788309672.424531:0:15347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210561536 00000100:00100000:2.0:1788309672.424544:0:15347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210561536 00000100:00100000:2.0:1788309672.424628:0:15347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210561408 00000100:00100000:2.0:1788309672.424632:0:15347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210561408 00000100:00100000:2.0:1788309672.424645:0:15347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210561664 00000100:00100000:2.0:1788309672.424648:0:15347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210561664 00000100:00100000:2.0:1788309672.424666:0:15347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788309672.424684:0:15347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8eff0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875178210561536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309672.424800:0:15347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8eff0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875178210561536:12345-0@lo:400:kworker.0 Request processed in 125us (7194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309672.424808:0:15347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788309672.424823:0:15347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788309672.424829:0:15347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8eff0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875178210561408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309672.424859:0:15347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8eff0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875178210561408:12345-0@lo:400:kworker.0 Request processed in 30us (6046us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309672.424865:0:15347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788309672.424875:0:15347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788309672.424891:0:15347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8eff0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875178210561664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309672.424928:0:15347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8eff0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875178210561664:12345-0@lo:400:kworker.0 Request processed in 38us (5472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309672.424933:0:15347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788309672.424977:0:16007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210561280 00000100:00100000:2.0:1788309672.424981:0:16007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210561280 00000100:00100000:2.0:1788309672.425008:0:16007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210561152 00000100:00100000:2.0:1788309672.425011:0:16007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210561152 00000100:00100000:2.0:1788309672.425032:0:16007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788309672.425039:0:16007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8eff0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3303:x1875178210561280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309672.425071:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788309672.425071:0:16007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8eff0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3303:x1875178210561280:12345-0@lo:400:kworker.0 Request processed in 33us (5754us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309672.425076:0:16007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788309672.425079:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8eff0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210561152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309672.425120:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8eff0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210561152:12345-0@lo:400:kworker.0 Request processed in 42us (5713us total) trans 0 rc 0/0 00000100:00080000:2.0:1788309672.425129:0:14358:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788309672.425133:0:14358:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788309672.425136:0:14358:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788309672.425139:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788309672.425183:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210561152:0@lo:400:kworker.0 00010000:00080000:2.0:1788309672.425201:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8eff0ea00 x1875178210561664/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309688 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788309672.425215:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875178210561664:0@lo:400:kworker.0 00000100:00100000:2.0:1788309672.425229:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210561280:0@lo:400:kworker.0 00010000:00080000:2.0:1788309672.425606:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8eff0df80 x1875178210561408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309688 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788309672.425618:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875178210561408:0@lo:400:kworker.0 00000100:00100000:2.0:1788309672.425632:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a1139bce-bc3d-41b1-9121-b11888b6dcf4:3301:1875178210561024:0@lo:400:kworker.0 00010000:00080000:2.0:1788309672.425657:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8eff0d500 x1875178210561536/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309688 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788309672.425666:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8eff0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875178210561536:0@lo:400:kworker.0 00000100:00100000:1.0:1788309672.455248:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788309672.455552:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc91f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875178210561792:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788309672.455733:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309672.455831:0:15049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210561792 00000100:00100000:1.0:1788309672.455842:0:15049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210561792 00000100:00100000:1.0:1788309672.456554:0:15049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788309672.456570:0:15049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecb40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1875178210561792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788309672.456628:0:15049:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788309672.458342:0:15049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecb40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1875178210561792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1756us (2649us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309672.458366:0:15049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788309672.458804:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc91f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875178210561792:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788309672.611018:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788309672.629796:0:7639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00010000:00010000:3.0:1788309673.634988:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788309674.174977:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309674.175257:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192740096 00000100:00100000:3.0:1788309674.175313:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192740096 00000100:00100000:3.0:1788309674.175397:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 76 00000100:00100000:3.0:1788309674.175409:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ee53e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2349:x1875178192740096:12345-192.168.202.55@tcp:250:mount.lustre.0 00010000:00080000:3.0:1788309674.175464:0:14355:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from b2082d80-0399-454d-94d0-622e1b077a92@192.168.202.55@tcp t0 exp 0000000000000000 cur 436 last 0 00000020:00000080:3.0:1788309674.175852:0:14355:0:(genops.c:1385:class_connect()) connect: client b2082d80-0399-454d-94d0-622e1b077a92, cookie 0x63a04852f46299da 00000100:00080000:3.0:1788309674.176076:0:14355:0:(import.c:65:import_set_state_nolock()) ffff97c7c257d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788309674.176191:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ee53e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2082d80-0399-454d-94d0-622e1b077a92+5:2349:x1875178192740096:12345-192.168.202.55@tcp:250:mount.lustre.0 Request processed in 781us (1231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309674.176203:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 76 00000100:00100000:2.0:1788309674.191056:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309674.193090:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192740224 00000100:00100000:3.0:1788309674.193112:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192740224 00000100:00100000:3.0:1788309674.193205:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 77 00000100:00100000:3.0:1788309674.193221:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ee53fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2082d80-0399-454d-94d0-622e1b077a92+5:13732:x1875178192740224:12345-192.168.202.55@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788309674.193273:0:14357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309674.193845:0:14357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c8c0031000/0x63a04852f46299e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ad8f expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309674.193902:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8c0031000/0x63a04852f46299e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad8f expref: 6 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309674.193916:0:14357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c8c0031000/0x63a04852f46299e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad8f expref: 6 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309674.193929:0:14357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8c0031000, rc 0) 00000100:00100000:3.0:1788309674.194032:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ee53fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2082d80-0399-454d-94d0-622e1b077a92+6:13732:x1875178192740224:12345-192.168.202.55@tcp:101:mount.lustre.0 Request processed in 815us (2992us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309674.194040:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 77 00000100:00100000:1.0:1788309674.231297:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309674.231370:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192740352 00000100:00100000:1.0:1788309674.231385:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192740352 00000100:00100000:1.0:1788309674.231462:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 78 00000100:00100000:1.0:1788309674.234916:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f522f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2082d80-0399-454d-94d0-622e1b077a92+6:13732:x1875178192740352:12345-192.168.202.55@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788309674.239078:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f522f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2082d80-0399-454d-94d0-622e1b077a92+6:13732:x1875178192740352:12345-192.168.202.55@tcp:501:mount.lustre.0 Request processed in 7590us (7802us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788309674.239098:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 78 00000100:00100000:3.0:1788309674.258092:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309674.258695:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192740480 00000100:00100000:1.0:1788309674.258709:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192740480 00000100:00100000:1.0:1788309674.258776:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 79 00000100:00100000:1.0:1788309674.258788:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f522c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2082d80-0399-454d-94d0-622e1b077a92+6:13732:x1875178192740480:12345-192.168.202.55@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788309674.258812:0:14355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788309674.258836:0:14355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c8f5549400/0x63a04852f46299e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ad96 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309674.258875:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8f5549400/0x63a04852f46299e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad96 expref: 7 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309674.258889:0:14355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c8f5549400/0x63a04852f46299e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ad96 expref: 7 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309674.258901:0:14355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8f5549400, rc 0) 00000100:00100000:1.0:1788309674.258980:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f522c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2082d80-0399-454d-94d0-622e1b077a92+7:13732:x1875178192740480:12345-192.168.202.55@tcp:101:mount.lustre.0 Request processed in 194us (5768us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309674.259005:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 79 00000100:00100000:1.0:1788309674.268420:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309674.269069:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192740608 00000100:00100000:3.0:1788309674.269086:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192740608 00000100:00100000:3.0:1788309674.269170:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 80 00000100:00100000:3.0:1788309674.269186:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f522e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2082d80-0399-454d-94d0-622e1b077a92+7:13732:x1875178192740608:12345-192.168.202.55@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788309674.270162:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f522e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2082d80-0399-454d-94d0-622e1b077a92+8:13732:x1875178192740608:12345-192.168.202.55@tcp:501:mount.lustre.0 Request processed in 974us (1753us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309674.270175:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 80 00000100:00100000:3.0:1788309674.275364:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309674.275570:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192740736 00000100:00100000:2.0:1788309674.275587:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192740736 00000100:00100000:2.0:1788309674.275869:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 81 00000100:00100000:2.0:1788309674.275882:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f522fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2082d80-0399-454d-94d0-622e1b077a92+8:13732:x1875178192740736:12345-192.168.202.55@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788309674.291902:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f522fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2082d80-0399-454d-94d0-622e1b077a92+8:13732:x1875178192740736:12345-192.168.202.55@tcp:503:mount.lustre.0 Request processed in 15999us (16533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309674.291926:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 81 00000100:00100000:3.0:1788309674.311957:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309674.312021:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192740864 00000100:00100000:3.0:1788309674.312033:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192740864 00000100:00100000:3.0:1788309674.312098:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 82 00000100:00100000:3.0:1788309674.312125:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f522ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2082d80-0399-454d-94d0-622e1b077a92+8:13751:x1875178192740864:12345-192.168.202.55@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788309674.312648:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f522ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2082d80-0399-454d-94d0-622e1b077a92+8:13751:x1875178192740864:12345-192.168.202.55@tcp:502:llog_process_th.0 Request processed in 523us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309674.314222:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 82 00000100:00100000:1.0:1788309674.343446:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309674.343630:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192740992 00000100:00100000:0.0:1788309674.343646:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192740992 00000100:00100000:0.0:1788309674.343737:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 83 00000100:00100000:0.0:1788309674.343750:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f522d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2082d80-0399-454d-94d0-622e1b077a92+8:13751:x1875178192740992:12345-192.168.202.55@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788309674.344139:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f522d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2082d80-0399-454d-94d0-622e1b077a92+8:13751:x1875178192740992:12345-192.168.202.55@tcp:502:llog_process_th.0 Request processed in 389us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309674.344148:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 83 00000100:00100000:2.0:1788309674.351271:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309674.351669:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192741120 00000100:00100000:3.0:1788309674.351692:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192741120 00000100:00100000:3.0:1788309674.351783:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 84 00000100:00100000:3.0:1788309674.351796:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f522e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2082d80-0399-454d-94d0-622e1b077a92+8:13732:x1875178192741120:12345-192.168.202.55@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788309674.351816:0:14357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309674.351836:0:14357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c8c0030800/0x63a04852f46299ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8a28c761146adc0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309674.351872:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8c0030800/0x63a04852f46299ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146adc0 expref: 9 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309674.351884:0:14357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c8c0030800/0x63a04852f46299ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146adc0 expref: 9 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309674.351894:0:14357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8c0030800, rc 0) 00000100:00100000:3.0:1788309674.352023:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f522e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2082d80-0399-454d-94d0-622e1b077a92+9:13732:x1875178192741120:12345-192.168.202.55@tcp:101:mount.lustre.0 Request processed in 230us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309674.352029:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 84 00000100:00100000:1.0:1788309674.355806:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309674.356120:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192741248 00000100:00100000:3.0:1788309674.356131:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192741248 00000100:00100000:3.0:1788309674.356242:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 85 00000100:00100000:3.0:1788309674.356254:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f522d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2082d80-0399-454d-94d0-622e1b077a92+9:13732:x1875178192741248:12345-192.168.202.55@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788309674.356313:0:14356:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788309674.356364:0:14356:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788309674.356368:0:14356:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788309674.356372:0:14356:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788309674.356374:0:14356:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1788309674.358471:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f522d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2082d80-0399-454d-94d0-622e1b077a92+9:13732:x1875178192741248:12345-192.168.202.55@tcp:256:mount.lustre.0 Request processed in 2210us (2664us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309674.358493:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 85 00000100:00100000:1.0:1788309674.361613:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309674.361705:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192741376 00000100:00100000:0.0:1788309674.361724:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192741376 00000100:00100000:0.0:1788309674.361809:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 86 00000100:00100000:0.0:1788309674.361823:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f522c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2082d80-0399-454d-94d0-622e1b077a92+9:13732:x1875178192741376:12345-192.168.202.55@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788309674.361845:0:14355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788309674.361868:0:14355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c8ecf2ea00/0x63a04852f46299f6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8a28c761146adc7 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309674.361916:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8ecf2ea00/0x63a04852f46299f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146adc7 expref: 10 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309674.361929:0:14355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c8ecf2ea00/0x63a04852f46299f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146adc7 expref: 10 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309674.361941:0:14355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8ecf2ea00, rc 0) 00000100:00100000:0.0:1788309674.362022:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f522c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2082d80-0399-454d-94d0-622e1b077a92+10:13732:x1875178192741376:12345-192.168.202.55@tcp:101:mount.lustre.0 Request processed in 203us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309674.362052:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 86 00000100:00100000:1.0:1788309674.364535:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309674.364799:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192741504 00000100:00100000:3.0:1788309674.364810:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192741504 00000100:00100000:3.0:1788309674.364899:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 87 00000100:00100000:3.0:1788309674.364911:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f522dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2082d80-0399-454d-94d0-622e1b077a92+10:13732:x1875178192741504:12345-192.168.202.55@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788309674.365242:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f522dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2082d80-0399-454d-94d0-622e1b077a92+10:13732:x1875178192741504:12345-192.168.202.55@tcp:501:mount.lustre.0 Request processed in 333us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309674.365250:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 87 00000100:00100000:1.0:1788309674.381206:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309674.381562:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192741632 00000100:00100000:0.0:1788309674.381575:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192741632 00000100:00100000:1.0:1788309674.381757:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 88 00000100:00100000:1.0:1788309674.381771:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f522cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2082d80-0399-454d-94d0-622e1b077a92+10:13732:x1875178192741632:12345-192.168.202.55@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788309674.382209:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f522cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2082d80-0399-454d-94d0-622e1b077a92+10:13732:x1875178192741632:12345-192.168.202.55@tcp:503:mount.lustre.0 Request processed in 440us (1014us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309674.382218:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 88 00000100:00100000:1.0:1788309674.402712:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309674.402939:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192741760 00000100:00100000:3.0:1788309674.402956:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192741760 00000100:00100000:3.0:1788309674.403075:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 89 00000100:00100000:3.0:1788309674.403088:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f522d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2082d80-0399-454d-94d0-622e1b077a92+10:13756:x1875178192741760:12345-192.168.202.55@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788309674.403491:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f522d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2082d80-0399-454d-94d0-622e1b077a92+10:13756:x1875178192741760:12345-192.168.202.55@tcp:502:llog_process_th.0 Request processed in 403us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309674.403500:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 89 00000100:00100000:3.0:1788309674.409621:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309674.416605:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192741888 00000100:00100000:1.0:1788309674.416623:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192741888 00000100:00100000:1.0:1788309674.416829:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 90 00000100:00100000:1.0:1788309674.416844:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f522f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2082d80-0399-454d-94d0-622e1b077a92+10:13756:x1875178192741888:12345-192.168.202.55@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788309674.417157:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f522f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2082d80-0399-454d-94d0-622e1b077a92+10:13756:x1875178192741888:12345-192.168.202.55@tcp:502:llog_process_th.0 Request processed in 316us (7548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309674.417166:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 90 00000100:00100000:1.0:1788309674.458247:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309674.459391:0:15347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192742016 00000100:00100000:2.0:1788309674.459403:0:15347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192742016 00000100:00100000:3.0:1788309674.459673:0:15347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 4 00000100:00100000:3.0:1788309674.459683:0:15347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecb41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2349:x1875178192742016:12345-192.168.202.55@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788309674.459713:0:15347:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 6fcd26c6-50ab-4098-99a3-ad6ed6abb600@192.168.202.55@tcp t0 exp 0000000000000000 cur 437 last 0 00000020:00000080:3.0:1788309674.459765:0:15347:0:(genops.c:1385:class_connect()) connect: client 6fcd26c6-50ab-4098-99a3-ad6ed6abb600, cookie 0x63a04852f46299fd 00000004:00100000:3.0:1788309674.459808:0:15347:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1788309674.459814:0:15347:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:0.0:1788309674.518387:0:15347:0:(import.c:65:import_set_state_nolock()) ffff97c8efc6a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788309674.518489:0:15347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecb41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+6:2349:x1875178192742016:12345-192.168.202.55@tcp:38:mount.lustre.0 Request processed in 58804us (60248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309674.518505:0:15347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 4 00000100:00100000:3.0:1788309674.523536:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309674.523847:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192742272 00000100:00100000:2.0:1788309674.523859:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192742272 00000100:00100000:2.0:1788309674.523947:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 5 00000100:00100000:2.0:1788309674.523960:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc91c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+6:13732:x1875178192742272:12345-192.168.202.55@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788309674.524009:0:14364:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788309674.524113:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc91c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+6:13732:x1875178192742272:12345-192.168.202.55@tcp:41:mount.lustre.0 Request processed in 155us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309674.524121:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 5 00000100:00100000:3.0:1788309674.524609:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309674.524638:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192742144 00000100:00100000:3.0:1788309674.524643:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192742144 00000100:00080000:0.0:1788309674.525869:0:14358:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788309674.526029:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 6 00000100:00100000:3.0:1788309674.526045:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc91f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+6:0:x1875178192742144:12345-192.168.202.55@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788309674.526074:0:14363:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788309674.526151:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc91f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+6:0:x1875178192742144:12345-192.168.202.55@tcp:41:mount.lustre.0 Request processed in 112us (1542us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309674.526159:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 6 00000100:00100000:3.0:1788309674.530751:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309674.531114:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192742400 00000100:00100000:2.0:1788309674.531125:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192742400 00000100:00100000:2.0:1788309674.531194:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 7 00000100:00100000:2.0:1788309674.531207:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc91d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+6:13732:x1875178192742400:12345-192.168.202.55@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788309674.537435:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc91d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+6:13732:x1875178192742400:12345-192.168.202.55@tcp:40:mount.lustre.0 Request processed in 6213us (6678us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309674.537452:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 7 00000100:00100000:2.0:1788309674.540327:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309674.540371:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309674.540407:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309674.540652:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192742784 00000100:00100000:1.0:1788309674.540673:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192742784 00000100:00100000:1.0:1788309674.540724:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 0 00000100:00100000:1.0:1788309674.540735:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8eff0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+6:13732:x1875178192742784:12345-192.168.202.55@tcp:33:mount.lustre.0 00000100:00100000:3.0:1788309674.540812:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192742528 00000100:00100000:3.0:1788309674.540819:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192742528 00000100:00100000:3.0:1788309674.540845:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192742656 00000100:00100000:3.0:1788309674.540849:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192742656 00000100:00100000:3.0:1788309674.540877:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 8 00000100:00100000:3.0:1788309674.540884:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8eff0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2349:x1875178192742528:12345-192.168.202.55@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788309674.540912:0:15046:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 6fcd26c6-50ab-4098-99a3-ad6ed6abb600@192.168.202.55@tcp t0 exp 0000000000000000 cur 437 last 0 00000100:00100000:1.0:1788309674.540928:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 9 00000100:00100000:1.0:1788309674.540935:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8eff0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2349:x1875178192742656:12345-192.168.202.55@tcp:8:mount.lustre.0 00000020:00000080:3.0:1788309674.540944:0:15046:0:(genops.c:1385:class_connect()) connect: client 6fcd26c6-50ab-4098-99a3-ad6ed6abb600, cookie 0x63a04852f4629a04 00010000:00080000:1.0:1788309674.540956:0:15044:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 6fcd26c6-50ab-4098-99a3-ad6ed6abb600@192.168.202.55@tcp t0 exp 0000000000000000 cur 437 last 0 00002000:00100000:3.0:1788309674.540957:0:15046:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6fcd26c6-50ab-4098-99a3-ad6ed6abb600/ffff97c7c2579000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392d ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000020:00000080:1.0:1788309674.540985:0:15044:0:(genops.c:1385:class_connect()) connect: client 6fcd26c6-50ab-4098-99a3-ad6ed6abb600, cookie 0x63a04852f4629a0b 00002000:00100000:3.0:1788309674.540986:0:15046:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00100000:1.0:1788309674.540994:0:15044:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6fcd26c6-50ab-4098-99a3-ad6ed6abb600/ffff97c7c2ed3000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392d ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788309674.541012:0:15044:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788309674.541799:0:15044:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788309674.541832:0:15044:0:(import.c:65:import_set_state_nolock()) ffff97c7c2ed5000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788309674.541902:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8eff0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+6:2349:x1875178192742656:12345-192.168.202.55@tcp:8:mount.lustre.0 Request processed in 964us (1529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309674.541911:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 9 00000004:00080000:1.0:1788309674.542077:0:14365:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1255us 00002000:00080000:3.0:1788309674.542981:0:15046:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788309674.543008:0:15046:0:(import.c:65:import_set_state_nolock()) ffff97c7c2578000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788309674.543046:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8eff0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+6:2349:x1875178192742528:12345-192.168.202.55@tcp:8:mount.lustre.0 Request processed in 2163us (2777us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309674.543060:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 8 00000004:00200000:1.0:1788309674.558387:0:14365:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:1.0:1788309674.558601:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8eff0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+6:13732:x1875178192742784:12345-192.168.202.55@tcp:33:mount.lustre.0 Request processed in 17859us (18184us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309674.558616:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 0 00010000:00010000:3.0:1788309674.656836:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788309674.744251:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309674.747968:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192742912 00000100:00100000:3.0:1788309674.747985:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192742912 00000100:00100000:3.0:1788309674.748055:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 8 00000100:00100000:3.0:1788309674.748067:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8eff0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+6:13777:x1875178192742912:12345-192.168.202.55@tcp:101:mkdir.0 00010000:00010000:3.0:1788309674.748089:0:14363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309674.748534:0:14363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c0031200/0x63a04852f4629a12 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146adf1 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309674.749075:0:14363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c0030e00/0x63a04852f4629a19 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309674.749100:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c0030e00/0x63a04852f4629a19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309674.749117:0:14363:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c0030e00/0x63a04852f4629a19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788309674.749473:0:14363:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1788309674.749478:0:14363:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1788309674.749579:0:14363:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c0030e00/0x63a04852f4629a19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309674.749609:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c0031200/0x63a04852f4629a12 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146adf1 expref: 8 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309674.749627:0:14363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c0030e00/0x63a04852f4629a19 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146adf1 expref: 7 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309674.749649:0:14363:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c902070400) 00010000:00010000:3.0:1788309674.749718:0:14363:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788309674.749723:0:14363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8c0030e00, rc 0) 00000100:00100000:3.0:1788309674.749789:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8eff0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+7:13777:x1875178192742912:12345-192.168.202.55@tcp:101:mkdir.0 Request processed in 1725us (5548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309674.749797:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 8 00000100:00100000:2.0:1788309674.981797:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecb43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210561920:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788309674.981874:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309674.985938:0:15049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210561920 00000100:00100000:0.0:1788309674.985953:0:15049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210561920 00000100:00100000:0.0:1788309674.986054:0:15049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788309674.986067:0:15049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8eff0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875178210561920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788309674.986098:0:15049:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788309674.986188:0:15049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8eff0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875178210561920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (4313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309674.986196:0:15049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788309674.986252:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecb43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875178210561920:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788309674.986859:0:14358:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788309675.680777:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788309676.193177:0:14394:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788309676.704772:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788309676.884547:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309676.884819:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192743040 00000100:00100000:2.0:1788309676.884831:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192743040 00000100:00100000:2.0:1788309676.884906:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 9 00000100:00100000:2.0:1788309676.884916:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffbb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+7:13830:x1875178192743040:12345-192.168.202.55@tcp:41:lfs.0 00000004:00000024:2.0:1788309676.884962:0:14362:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788309676.885056:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffbb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+7:13830:x1875178192743040:12345-192.168.202.55@tcp:41:lfs.0 Request processed in 141us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309676.885062:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 9 00000100:00080000:0.0:1788309676.885126:0:14358:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788309676.893673:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309676.894040:0:15049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192743168 00000100:00100000:0.0:1788309676.894052:0:15049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192743168 00000100:00080000:2.0:1788309676.894187:0:14358:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788309676.894246:0:15049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 6 00000100:00100000:0.0:1788309676.894259:0:15049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8eff0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+6:13830:x1875178192743168:12345-192.168.202.55@tcp:13:lfs.0 00002000:00000024:0.0:1788309676.894367:0:15049:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788309676.894467:0:15049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8eff0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+6:13830:x1875178192743168:12345-192.168.202.55@tcp:13:lfs.0 Request processed in 211us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309676.894485:0:15049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 6 00000100:00100000:3.0:1788309676.900874:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309676.901168:0:15048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192743296 00000100:00100000:1.0:1788309676.901178:0:15048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192743296 00000100:00100000:1.0:1788309676.901348:0:15048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 7 00000100:00100000:1.0:1788309676.901359:0:15048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc91c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+6:13830:x1875178192743296:12345-192.168.202.55@tcp:13:lfs.0 00002000:00000024:1.0:1788309676.901406:0:15048:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788309676.901497:0:15048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc91c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+6:13830:x1875178192743296:12345-192.168.202.55@tcp:13:lfs.0 Request processed in 132us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309676.901506:0:15048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 7 00000100:00080000:2.0:1788309676.903001:0:14358:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788309677.347194:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309677.347841:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192743424 00000100:00100000:0.0:1788309677.347853:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192743424 00000100:00100000:1.0:1788309677.347986:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 91 00000100:00100000:1.0:1788309677.347997:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f522f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2082d80-0399-454d-94d0-622e1b077a92+10:13864:x1875178192743424:12345-192.168.202.55@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788309677.348013:0:14356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788309677.348030:0:14356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c8f5549200/0x63a04852f4629a20 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8a28c761146adf8 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309677.348061:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8f5549200/0x63a04852f4629a20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146adf8 expref: 11 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309677.348082:0:14356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c8f5549200/0x63a04852f4629a20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146adf8 expref: 11 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309677.348092:0:14356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8f5549200, rc 0) 00000100:00100000:1.0:1788309677.348652:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f522f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2082d80-0399-454d-94d0-622e1b077a92+11:13864:x1875178192743424:12345-192.168.202.55@tcp:101:mount.lustre.0 Request processed in 654us (1465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309677.348668:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 91 00000100:00100000:3.0:1788309677.366728:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309677.366919:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192743552 00000100:00100000:1.0:1788309677.366938:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192743552 00000100:00100000:1.0:1788309677.366991:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 92 00000100:00100000:1.0:1788309677.367001:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8f522c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2082d80-0399-454d-94d0-622e1b077a92+11:13864:x1875178192743552:12345-192.168.202.55@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788309677.367313:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8f522c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2082d80-0399-454d-94d0-622e1b077a92+11:13864:x1875178192743552:12345-192.168.202.55@tcp:501:mount.lustre.0 Request processed in 278us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309677.367321:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 92 00000100:00100000:3.0:1788309677.370550:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309677.370970:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192743680 00000100:00100000:1.0:1788309677.370980:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192743680 00000100:00100000:1.0:1788309677.371037:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 93 00000100:00100000:1.0:1788309677.371046:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffd9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2082d80-0399-454d-94d0-622e1b077a92+11:13864:x1875178192743680:12345-192.168.202.55@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788309677.371754:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffd9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2082d80-0399-454d-94d0-622e1b077a92+11:13864:x1875178192743680:12345-192.168.202.55@tcp:503:mount.lustre.0 Request processed in 278us (1050us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309677.371766:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 93 00000100:00100000:3.0:1788309677.380752:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309677.380953:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192743808 00000100:00100000:2.0:1788309677.380964:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192743808 00000100:00100000:2.0:1788309677.381026:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 94 00000100:00100000:2.0:1788309677.381038:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffd9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2082d80-0399-454d-94d0-622e1b077a92+11:13870:x1875178192743808:12345-192.168.202.55@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788309677.381407:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffd9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2082d80-0399-454d-94d0-622e1b077a92+11:13870:x1875178192743808:12345-192.168.202.55@tcp:502:llog_process_th.0 Request processed in 370us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309677.381416:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 94 00000100:00100000:3.0:1788309677.434168:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309677.434358:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192743936 00000100:00100000:1.0:1788309677.434371:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192743936 00000100:00100000:1.0:1788309677.434447:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 95 00000100:00100000:1.0:1788309677.434458:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffd9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2082d80-0399-454d-94d0-622e1b077a92+11:13870:x1875178192743936:12345-192.168.202.55@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788309677.434936:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffd9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2082d80-0399-454d-94d0-622e1b077a92+11:13870:x1875178192743936:12345-192.168.202.55@tcp:502:llog_process_th.0 Request processed in 478us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309677.434944:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 95 00000100:00100000:3.0:1788309677.445495:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309677.446396:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192744064 00000100:00100000:1.0:1788309677.446407:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192744064 00000100:00100000:1.0:1788309677.446470:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 96 00000100:00100000:1.0:1788309677.446488:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffd9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2082d80-0399-454d-94d0-622e1b077a92+11:13864:x1875178192744064:12345-192.168.202.55@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788309677.446507:0:14355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788309677.446533:0:14355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c8f5549c00/0x63a04852f4629a27 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ae22 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309677.446781:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8f5549c00/0x63a04852f4629a27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ae22 expref: 12 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309677.446794:0:14355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c8f5549c00/0x63a04852f4629a27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ae22 expref: 12 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309677.446805:0:14355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8f5549c00, rc 0) 00000100:00100000:1.0:1788309677.446938:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffd9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2082d80-0399-454d-94d0-622e1b077a92+12:13864:x1875178192744064:12345-192.168.202.55@tcp:101:mount.lustre.0 Request processed in 451us (1461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309677.446964:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 96 00000100:00100000:3.0:1788309677.466815:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309677.466915:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192744192 00000100:00100000:2.0:1788309677.466941:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192744192 00000100:00100000:2.0:1788309677.466993:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 97 00000100:00100000:2.0:1788309677.467003:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffd9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2082d80-0399-454d-94d0-622e1b077a92+12:13864:x1875178192744192:12345-192.168.202.55@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788309677.467029:0:14357:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788309677.467046:0:14357:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788309677.467050:0:14357:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788309677.467053:0:14357:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788309677.467055:0:14357:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1788309677.472537:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffd9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2082d80-0399-454d-94d0-622e1b077a92+12:13864:x1875178192744192:12345-192.168.202.55@tcp:256:mount.lustre.0 Request processed in 5519us (5717us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309677.472554:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 97 00000100:00100000:1.0:1788309677.486679:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309677.487124:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192744320 00000100:00100000:2.0:1788309677.487135:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192744320 00000100:00100000:2.0:1788309677.488826:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 98 00000100:00100000:2.0:1788309677.488849:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffd9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2082d80-0399-454d-94d0-622e1b077a92+12:13864:x1875178192744320:12345-192.168.202.55@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788309677.488869:0:14355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309677.488888:0:14355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c8e26d8800/0x63a04852f4629a2e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ae29 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309677.489671:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8e26d8800/0x63a04852f4629a2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ae29 expref: 13 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309677.489688:0:14355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c8e26d8800/0x63a04852f4629a2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ae29 expref: 13 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309677.489700:0:14355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8e26d8800, rc 0) 00000100:00100000:2.0:1788309677.489834:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffd9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2082d80-0399-454d-94d0-622e1b077a92+13:13864:x1875178192744320:12345-192.168.202.55@tcp:101:mount.lustre.0 Request processed in 993us (3165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309677.489860:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 98 00000100:00100000:3.0:1788309677.492586:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309677.492743:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192744448 00000100:00100000:2.0:1788309677.492754:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192744448 00000100:00100000:2.0:1788309677.492846:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 99 00000100:00100000:2.0:1788309677.492858:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffd9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2082d80-0399-454d-94d0-622e1b077a92+13:13864:x1875178192744448:12345-192.168.202.55@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788309677.493733:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffd9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2082d80-0399-454d-94d0-622e1b077a92+13:13864:x1875178192744448:12345-192.168.202.55@tcp:501:mount.lustre.0 Request processed in 872us (1156us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309677.493744:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 99 00000100:00100000:0.0:1788309677.505136:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309677.505814:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192744576 00000100:00100000:2.0:1788309677.505825:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192744576 00000100:00100000:2.0:1788309677.505887:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 100 00000100:00100000:2.0:1788309677.505898:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffd9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2082d80-0399-454d-94d0-622e1b077a92+13:13864:x1875178192744576:12345-192.168.202.55@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788309677.506151:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffd9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2082d80-0399-454d-94d0-622e1b077a92+13:13864:x1875178192744576:12345-192.168.202.55@tcp:503:mount.lustre.0 Request processed in 254us (1023us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309677.506159:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 100 00000100:00100000:1.0:1788309677.527015:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309677.527088:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192744704 00000100:00100000:2.0:1788309677.527098:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192744704 00000100:00100000:2.0:1788309677.527150:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 101 00000100:00100000:2.0:1788309677.527161:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffd9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2082d80-0399-454d-94d0-622e1b077a92+13:13874:x1875178192744704:12345-192.168.202.55@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788309677.527573:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffd9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2082d80-0399-454d-94d0-622e1b077a92+13:13874:x1875178192744704:12345-192.168.202.55@tcp:502:llog_process_th.0 Request processed in 412us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309677.527582:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 101 00000100:00100000:0.0:1788309677.540460:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffbb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875178210562432:0@lo:400:kworker.0 00000100:00100000:0.0:1788309677.540544:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309677.540634:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788309677.540641:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffbb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a1139bce-bc3d-41b1-9121-b11888b6dcf4:3300:1875178210562048:0@lo:400:kworker.0 00000100:00100000:0.0:1788309677.540676:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309677.540701:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffbb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875178210562560:0@lo:400:kworker.0 00000100:00100000:0.0:1788309677.540735:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309677.540764:0:15347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210562432 00000100:00100000:0.0:1788309677.540771:0:15347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210562432 00000100:00100000:0.0:1788309677.540813:0:15347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210562560 00000100:00100000:0.0:1788309677.540816:0:15347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210562560 00000100:00100000:0.0:1788309677.540841:0:15347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788309677.540850:0:15347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffbb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875178210562432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309677.540902:0:15347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffbb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875178210562432:12345-0@lo:400:kworker.0 Request processed in 53us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309677.540909:0:15347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788309677.540925:0:15347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788309677.540932:0:15347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffbb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875178210562560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309677.540958:0:15347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffbb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875178210562560:12345-0@lo:400:kworker.0 Request processed in 27us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309677.540976:0:15347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788309677.541019:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffbb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875178210562560:0@lo:400:kworker.0 00000100:00100000:0.0:1788309677.541028:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffbb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875178210562432:0@lo:400:kworker.0 00000100:00100000:1.0:1788309677.542846:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffbb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875178210562176:0@lo:400:kworker.0 00000100:00100000:1.0:1788309677.542920:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309677.542958:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffbb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875178210562688:0@lo:400:kworker.0 00000100:00100000:1.0:1788309677.542985:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309677.543011:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788309677.543018:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffbb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875178210562304:0@lo:400:kworker.0 00000100:00100000:1.0:1788309677.543040:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309677.543076:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210562688 00000100:00100000:1.0:1788309677.543082:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210562688 00000100:00100000:1.0:1788309677.543123:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788309677.543130:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecb40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875178210562688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309677.543179:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecb40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875178210562688:12345-0@lo:400:kworker.0 Request processed in 48us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309677.543186:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788309677.543209:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210562176 00000100:00100000:1.0:1788309677.543214:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210562176 00000100:00100000:1.0:1788309677.543238:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210562304 00000100:00100000:1.0:1788309677.543241:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210562304 00000100:00100000:1.0:1788309677.543260:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788309677.543266:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecb42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875178210562176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309677.543350:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecb42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875178210562176:12345-0@lo:400:kworker.0 Request processed in 84us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309677.543357:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1788309677.546111:0:14358:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788309677.546121:0:14358:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788309677.546147:0:14358:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788309677.546179:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210562048 00000100:00100000:2.0:1788309677.546190:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210562048 00000100:00100000:2.0:1788309677.546250:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788309677.546260:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffd9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1139bce-bc3d-41b1-9121-b11888b6dcf4+19:3300:x1875178210562048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309677.546409:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffd9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1139bce-bc3d-41b1-9121-b11888b6dcf4+19:3300:x1875178210562048:12345-0@lo:400:kworker.0 Request processed in 151us (5733us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309677.546417:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788309677.546491:0:16007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788309677.546501:0:16007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecb40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1875178210562304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309677.546556:0:16007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecb40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1875178210562304:12345-0@lo:400:kworker.0 Request processed in 46us (3503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309677.546563:0:16007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788309677.547317:0:3302:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1788309677.547339:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffbb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875178210562304:0@lo:400:kworker.0 00000100:00100000:0.0:1788309677.547866:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffbb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a1139bce-bc3d-41b1-9121-b11888b6dcf4:3300:1875178210562048:0@lo:400:kworker.0 00000100:00100000:1.0:1788309677.548241:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffbb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875178210562176:0@lo:400:kworker.0 00000100:00100000:3.0:1788309677.549039:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc91c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210562816:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788309677.549099:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309677.549183:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309677.549206:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192744832 00000100:00100000:3.0:1788309677.549211:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192744832 00000100:00100000:3.0:1788309677.549250:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 103 00000100:00100000:3.0:1788309677.549259:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ee48f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2082d80-0399-454d-94d0-622e1b077a92+13:13874:x1875178192744832:12345-192.168.202.55@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788309677.549525:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ee48f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2082d80-0399-454d-94d0-622e1b077a92+13:13874:x1875178192744832:12345-192.168.202.55@tcp:502:llog_process_th.0 Request processed in 264us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309677.549539:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 103 00000100:00100000:1.0:1788309677.550824:0:15048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210562816 00000100:00100000:1.0:1788309677.550833:0:15048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210562816 00000100:00100000:1.0:1788309677.550879:0:15048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788309677.550889:0:15048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc91e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210562816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788309677.550908:0:15048:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788309677.550969:0:15048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc91e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210562816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (1871us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309677.550976:0:15048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788309677.551021:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc91c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210562816:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788309677.566205:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309677.568237:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192744960 00000100:00100000:1.0:1788309677.568253:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192744960 00000100:00100000:1.0:1788309677.568379:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 10 00000100:00100000:1.0:1788309677.568400:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc91ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2349:x1875178192744960:12345-192.168.202.55@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788309677.568438:0:14364:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 58cbd1af-e5b9-4e74-a0c2-c243cb2213cd@192.168.202.55@tcp t0 exp 0000000000000000 cur 440 last 0 00000020:00000080:1.0:1788309677.568513:0:14364:0:(genops.c:1385:class_connect()) connect: client 58cbd1af-e5b9-4e74-a0c2-c243cb2213cd, cookie 0x63a04852f4629a35 00000004:00100000:1.0:1788309677.568827:0:14364:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788309677.568986:0:14364:0:(import.c:65:import_set_state_nolock()) ffff97c7c2ed7000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788309677.569068:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc91ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58cbd1af-e5b9-4e74-a0c2-c243cb2213cd+6:2349:x1875178192744960:12345-192.168.202.55@tcp:38:mount.lustre.0 Request processed in 668us (2872us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309677.569076:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 10 00000100:00100000:0.0:1788309677.572508:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffbb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875178210562688:0@lo:400:kworker.0 00000100:00100000:0.0:1788309677.589942:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309677.590011:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309677.593373:0:15347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192745216 00000100:00100000:3.0:1788309677.593398:0:15347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192745216 00000100:00100000:3.0:1788309677.593518:0:15347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192745088 00000100:00100000:3.0:1788309677.593522:0:15347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192745088 00000100:00100000:3.0:1788309677.593901:0:15347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 11 00000100:00100000:3.0:1788309677.593913:0:15347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffbb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58cbd1af-e5b9-4e74-a0c2-c243cb2213cd+7:13864:x1875178192745216:12345-192.168.202.55@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788309677.593962:0:15347:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788309677.594044:0:15347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffbb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58cbd1af-e5b9-4e74-a0c2-c243cb2213cd+7:13864:x1875178192745216:12345-192.168.202.55@tcp:41:mount.lustre.0 Request processed in 133us (4113us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309677.594053:0:15347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 11 00000100:00100000:3.0:1788309677.594074:0:15347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 12 00000100:00100000:3.0:1788309677.594081:0:15347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffbb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58cbd1af-e5b9-4e74-a0c2-c243cb2213cd+6:0:x1875178192745088:12345-192.168.202.55@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788309677.594092:0:15347:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788309677.594114:0:15347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffbb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58cbd1af-e5b9-4e74-a0c2-c243cb2213cd+6:0:x1875178192745088:12345-192.168.202.55@tcp:41:mount.lustre.0 Request processed in 33us (4103us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309677.594120:0:15347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 12 00000100:00080000:0.0:1788309677.595205:0:14358:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788309677.613016:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309677.613108:0:15347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192745344 00000100:00100000:3.0:1788309677.613119:0:15347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192745344 00000100:00100000:3.0:1788309677.613188:0:15347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 13 00000100:00100000:3.0:1788309677.613200:0:15347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecb41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58cbd1af-e5b9-4e74-a0c2-c243cb2213cd+6:13864:x1875178192745344:12345-192.168.202.55@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788309677.613347:0:15347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecb41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58cbd1af-e5b9-4e74-a0c2-c243cb2213cd+6:13864:x1875178192745344:12345-192.168.202.55@tcp:40:mount.lustre.0 Request processed in 149us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309677.613355:0:15347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 13 00000100:00100000:0.0:1788309677.637259:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309677.637358:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309677.637395:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309677.637554:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192745728 00000100:00100000:2.0:1788309677.637571:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192745728 00000100:00100000:2.0:1788309677.637634:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 1 00000100:00100000:2.0:1788309677.637645:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffbb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58cbd1af-e5b9-4e74-a0c2-c243cb2213cd+6:13864:x1875178192745728:12345-192.168.202.55@tcp:33:mount.lustre.0 00000004:00200000:2.0:1788309677.637867:0:14366:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1788309677.638008:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffbb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58cbd1af-e5b9-4e74-a0c2-c243cb2213cd+6:13864:x1875178192745728:12345-192.168.202.55@tcp:33:mount.lustre.0 Request processed in 364us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309677.638017:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 1 00000100:00100000:2.0:1788309677.638045:0:16007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192745472 00000100:00100000:2.0:1788309677.638049:0:16007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192745472 00000100:00100000:2.0:1788309677.638066:0:16007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192745600 00000100:00100000:2.0:1788309677.638069:0:16007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192745600 00000100:00100000:2.0:1788309677.638083:0:16007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 10 00000100:00100000:2.0:1788309677.638089:0:16007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffbb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2349:x1875178192745472:12345-192.168.202.55@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788309677.638123:0:16007:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 58cbd1af-e5b9-4e74-a0c2-c243cb2213cd@192.168.202.55@tcp t0 exp 0000000000000000 cur 440 last 0 00000020:00000080:2.0:1788309677.638157:0:16007:0:(genops.c:1385:class_connect()) connect: client 58cbd1af-e5b9-4e74-a0c2-c243cb2213cd, cookie 0x63a04852f4629a3c 00002000:00100000:2.0:1788309677.638169:0:16007:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 58cbd1af-e5b9-4e74-a0c2-c243cb2213cd/ffff97c8f52d4800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392d ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788309677.638180:0:16007:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788309677.638269:0:16007:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788309677.638330:0:16007:0:(import.c:65:import_set_state_nolock()) ffff97c8d93c0000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788309677.638360:0:16007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffbb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:58cbd1af-e5b9-4e74-a0c2-c243cb2213cd+6:2349:x1875178192745472:12345-192.168.202.55@tcp:8:mount.lustre.0 Request processed in 269us (1003us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309677.638368:0:16007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 10 00000100:00100000:2.0:1788309677.638381:0:16007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 11 00000100:00100000:2.0:1788309677.638592:0:16007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffbb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2349:x1875178192745600:12345-192.168.202.55@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788309677.638609:0:16007:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 58cbd1af-e5b9-4e74-a0c2-c243cb2213cd@192.168.202.55@tcp t0 exp 0000000000000000 cur 440 last 0 00000020:00000080:2.0:1788309677.638626:0:16007:0:(genops.c:1385:class_connect()) connect: client 58cbd1af-e5b9-4e74-a0c2-c243cb2213cd, cookie 0x63a04852f4629a43 00002000:00100000:2.0:1788309677.638632:0:16007:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 58cbd1af-e5b9-4e74-a0c2-c243cb2213cd/ffff97c8d93c4000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392d ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788309677.638639:0:16007:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788309677.638798:0:16007:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788309677.638816:0:16007:0:(import.c:65:import_set_state_nolock()) ffff97c8ee5c9800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788309677.638856:0:16007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffbb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:58cbd1af-e5b9-4e74-a0c2-c243cb2213cd+6:2349:x1875178192745600:12345-192.168.202.55@tcp:8:mount.lustre.0 Request processed in 265us (1471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309677.666541:0:16007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 11 00000001:00100000:0.0:1788309677.681642:0:7639:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6fcd26c6-50ab-4098-99a3-ad6ed6abb600 00010000:00010000:3.0:1788309677.728894:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788309678.071897:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309678.071993:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192745856 00000100:00100000:3.0:1788309678.072004:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192745856 00000100:00100000:3.0:1788309678.072069:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 14 00000100:00100000:3.0:1788309678.072079:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecb43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58cbd1af-e5b9-4e74-a0c2-c243cb2213cd+6:13895:x1875178192745856:12345-192.168.202.55@tcp:101:mkdir.0 00010000:00010000:3.0:1788309678.072099:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309678.072121:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c0031200/0x63a04852f4629a4a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ae53 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309678.072198:0:14362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c0030400/0x63a04852f4629a51 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309678.072212:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c0030400/0x63a04852f4629a51 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309678.072223:0:14362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c0030400/0x63a04852f4629a51 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788309678.072613:0:14362:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1788309678.072619:0:14362:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1788309678.072835:0:14362:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c0030400/0x63a04852f4629a51 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309678.072865:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c0031200/0x63a04852f4629a4a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ae53 expref: 8 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309678.072882:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c0030400/0x63a04852f4629a51 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ae53 expref: 7 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309678.072891:0:14362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c902070400) 00010000:00010000:3.0:1788309678.072900:0:14362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788309678.072903:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8c0030400, rc 0) 00000100:00100000:3.0:1788309678.073024:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecb43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58cbd1af-e5b9-4e74-a0c2-c243cb2213cd+7:13895:x1875178192745856:12345-192.168.202.55@tcp:101:mkdir.0 Request processed in 945us (1138us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309678.073032:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 14 00000001:00100000:1.0:1788309678.615657:0:6706:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 58cbd1af-e5b9-4e74-a0c2-c243cb2213cd 00000001:00100000:1.0:1788309678.615675:0:6706:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6fcd26c6-50ab-4098-99a3-ad6ed6abb600 00010000:00010000:3.0:1788309678.767813:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788309679.685686:0:5859:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6fcd26c6-50ab-4098-99a3-ad6ed6abb600 00000001:00100000:2.0:1788309679.685705:0:5859:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 58cbd1af-e5b9-4e74-a0c2-c243cb2213cd 00010000:00010000:2.0:1788309679.776850:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788309680.100122:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788309680.100157:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecb41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210562944:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788309680.100266:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309680.100563:0:15048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210562944 00000100:00100000:1.0:1788309680.100573:0:15048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210562944 00000100:00100000:1.0:1788309680.101842:0:15048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788309680.101863:0:15048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6585880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875178210562944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788309680.101919:0:15048:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788309680.102022:0:15048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6585880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875178210562944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 166us (1756us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309680.102037:0:15048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788309680.102112:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecb41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210562944:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788309680.105551:0:14358:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788309680.809412:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788309681.362397:0:16328:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1788309681.824440:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788309682.658315:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc91ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210563072:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788309682.658414:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309682.659125:0:15048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210563072 00000100:00100000:1.0:1788309682.659135:0:15048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210563072 00000100:00100000:1.0:1788309682.659196:0:15048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788309682.659208:0:15048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffbb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875178210563072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788309682.659261:0:15048:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788309682.659989:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e6586680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210563328:0@lo:400:kworker.0 00000100:00100000:3.0:1788309682.661936:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e6587480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875178210563456:0@lo:400:kworker.0 00000100:00100000:3.0:1788309682.662005:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309682.662507:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309682.662580:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788309682.662588:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e6585500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a1139bce-bc3d-41b1-9121-b11888b6dcf4:3303:1875178210563200:0@lo:400:kworker.0 00000100:00100000:2.0:1788309682.662623:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309682.662646:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e6585180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875178210563712:0@lo:400:kworker.0 00000100:00100000:2.0:1788309682.662682:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210563200 00000100:00100000:2.0:1788309682.662690:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210563200 00000100:00100000:2.0:1788309682.662737:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788309682.662866:0:15048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffbb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875178210563072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3659us (4450us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309682.662878:0:15048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1788309682.663315:0:14358:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788309682.663475:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788309682.663485:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e6584a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875178210563584:0@lo:400:kworker.0 00000100:00100000:3.0:1788309682.663521:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309682.663554:0:15347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210563456 00000100:00100000:3.0:1788309682.663559:0:15347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210563456 00000100:00100000:3.0:1788309682.663590:0:15347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210563584 00000100:00100000:3.0:1788309682.663594:0:15347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210563584 00000100:00100000:1.0:1788309682.667515:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309682.667599:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210563712 00000100:00100000:1.0:1788309682.667610:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210563712 00000100:00100000:2.0:1788309682.667692:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ee48d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1139bce-bc3d-41b1-9121-b11888b6dcf4+19:3303:x1875178210563200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309682.667784:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ee48d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1139bce-bc3d-41b1-9121-b11888b6dcf4+19:3303:x1875178210563200:12345-0@lo:400:kworker.0 Request processed in 102us (5160us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309682.667794:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788309682.673307:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788309682.673338:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc91dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875178210563456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309682.673461:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc91dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875178210563456:12345-0@lo:400:kworker.0 Request processed in 141us (11455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309682.673488:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788309682.673509:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788309682.673516:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecb41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875178210563712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309682.673549:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecb41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875178210563712:12345-0@lo:400:kworker.0 Request processed in 34us (6045us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309682.673555:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788309682.673804:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e6587480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875178210563456:0@lo:400:kworker.0 00000100:00100000:1.0:1788309682.673850:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e6585500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a1139bce-bc3d-41b1-9121-b11888b6dcf4:3303:1875178210563200:0@lo:400:kworker.0 00000100:00100000:1.0:1788309682.673863:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e6585180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875178210563712:0@lo:400:kworker.0 00000100:00080000:3.0:1788309682.674517:0:14358:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788309682.674540:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210563328 00000100:00100000:3.0:1788309682.674550:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210563328 00000100:00100000:3.0:1788309682.674675:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788309682.674684:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6584380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210563328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309682.674744:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6584380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210563328:12345-0@lo:400:kworker.0 Request processed in 62us (12238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309682.674750:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1788309682.674777:0:14358:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788309682.674811:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc91ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210563072:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788309682.674865:0:15347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788309682.674874:0:15347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc91c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875178210563584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309682.674925:0:15347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc91c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875178210563584:12345-0@lo:400:kworker.0 Request processed in 53us (11403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309682.674931:0:15347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788309682.675177:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e6584a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875178210563584:0@lo:400:kworker.0 00000100:00100000:1.0:1788309682.675201:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e6586680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210563328:0@lo:400:kworker.0 00000001:00100000:0.0:1788309682.780969:0:7639:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 58cbd1af-e5b9-4e74-a0c2-c243cb2213cd 00010000:00010000:3.0:1788309682.848629:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788309683.154462:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309683.154522:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309683.154559:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192746112 00000100:00100000:1.0:1788309683.154572:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192746112 00000100:00100000:1.0:1788309683.154645:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 22 00000100:00100000:1.0:1788309683.154658:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecb43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+6:2353:x1875178192746112:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:2.0:1788309683.154859:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192745984 00000100:00100000:2.0:1788309683.154867:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192745984 00000100:00100000:2.0:1788309683.154916:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 105 00000100:00100000:2.0:1788309683.154927:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ee48ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2082d80-0399-454d-94d0-622e1b077a92+13:2353:x1875178192745984:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788309683.154988:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecb43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+6:2353:x1875178192746112:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 330us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309683.154996:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 22 00000100:00080000:1.0:1788309683.155022:0:14358:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788309683.158385:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309683.158439:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192746368 00000100:00100000:1.0:1788309683.158458:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192746368 00000100:00100000:1.0:1788309683.158525:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 7 00000100:00100000:1.0:1788309683.158535:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecb41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+5:2352:x1875178192746368:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788309683.158600:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecb41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+5:2352:x1875178192746368:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 67us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309683.158608:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 7 00000100:00080000:1.0:1788309683.158631:0:14358:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788309683.158697:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309683.158715:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192746624 00000100:00100000:1.0:1788309683.158719:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192746624 00000100:00100000:1.0:1788309683.158857:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 8 00000100:00100000:1.0:1788309683.158865:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e667f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:58cbd1af-e5b9-4e74-a0c2-c243cb2213cd+5:2352:x1875178192746624:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788309683.158890:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e667f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:58cbd1af-e5b9-4e74-a0c2-c243cb2213cd+5:2352:x1875178192746624:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 27us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309683.158897:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 8 00000100:00080000:1.0:1788309683.158908:0:14358:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788309683.158937:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309683.158949:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192746240 00000100:00100000:1.0:1788309683.158952:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192746240 00000100:00100000:1.0:1788309683.158973:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 9 00000100:00100000:1.0:1788309683.158978:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e667c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+5:2352:x1875178192746240:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788309683.159048:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e667c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+5:2352:x1875178192746240:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 69us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309683.159055:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 9 00000100:00080000:1.0:1788309683.159067:0:14358:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788309683.159100:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309683.159206:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309683.159222:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192746752 00000100:00100000:1.0:1788309683.159237:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192746752 00000100:00100000:1.0:1788309683.159264:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 10 00000100:00100000:1.0:1788309683.159270:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e667fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:58cbd1af-e5b9-4e74-a0c2-c243cb2213cd+5:2352:x1875178192746752:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788309683.159406:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e667fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:58cbd1af-e5b9-4e74-a0c2-c243cb2213cd+5:2352:x1875178192746752:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 52us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309683.159415:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 10 00000100:00080000:1.0:1788309683.159430:0:14358:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788309683.159529:0:15347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192746496 00000100:00100000:3.0:1788309683.159534:0:15347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192746496 00000100:00100000:3.0:1788309683.159625:0:15347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 23 00000100:00100000:3.0:1788309683.159633:0:15347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e667f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58cbd1af-e5b9-4e74-a0c2-c243cb2213cd+6:2352:x1875178192746496:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:2.0:1788309683.159644:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ee48ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2082d80-0399-454d-94d0-622e1b077a92+13:2353:x1875178192745984:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 4719us (5195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309683.159653:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 105 00000100:00100000:3.0:1788309683.159663:0:15347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e667f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58cbd1af-e5b9-4e74-a0c2-c243cb2213cd+6:2352:x1875178192746496:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 32us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309683.159669:0:15347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 23 00000100:00080000:3.0:1788309683.159688:0:14358:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788309683.873418:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309684.908852:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788309685.216924:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e667ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210563840:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788309685.217001:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309685.217138:0:15049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210563840 00000100:00100000:0.0:1788309685.217147:0:15049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210563840 00000100:00100000:0.0:1788309685.217223:0:15049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788309685.217234:0:15049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6586a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210563840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788309685.217298:0:15049:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1788309685.221769:0:14358:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788309685.222007:0:15049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6586a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210563840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4767us (4997us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309685.222036:0:15049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788309685.224841:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e667ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210563840:0@lo:13:osp-pre-0-0.0 00000020:00000080:3.0:1788309685.228892:0:16478:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd6bcf78c0 20000000:00000080:3.0:1788309685.228910:0:16478:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff97c7c2388800 uarg=0000000000000000 20000000:01000000:3.0:1788309685.228950:0:16478:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788309685.228958:0:16478:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788309685.228965:0:16478:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788309685.230215:0:16479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:3.0:1788309685.230887:0:16478:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788309685.239533:0:16478:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788309685.239898:0:16478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97c8c0031800/0x63a04852f4629a58 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309685.239924:0:16478:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c8ecf2e600/0x63a04852f462974f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f4629748 expref: 18 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309685.239932:0:16478:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c8f5548000/0x63a04852f462979c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f4629795 expref: 18 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309685.239939:0:16478:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c8f5548a00/0x63a04852f46298d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f46298d0 expref: 18 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309685.239964:0:16478:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c8ecf2ea00/0x63a04852f46299f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146adc7 expref: 12 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309685.239971:0:16478:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c8e26d8800/0x63a04852f4629a2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ae29 expref: 12 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309685.239980:0:16478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97c8c0031800/0x63a04852f4629a58 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309685.240036:0:16478:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c8e26d8800/0x63a04852f4629a2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ae29 expref: 12 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309685.240053:0:16478:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97c8e26d8800/0x63a04852f4629a2e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ae29 expref: 12 pid: 14355 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309685.240072:0:16478:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc91ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16478:1875178210563968:192.168.202.55@tcp:104: 00010000:00010000:3.0:1788309685.240201:0:16478:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c8ecf2ea00/0x63a04852f46299f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146adc7 expref: 12 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309685.240221:0:16478:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97c8ecf2ea00/0x63a04852f46299f6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146adc7 expref: 12 pid: 14355 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309685.240231:0:16478:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc91f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16478:1875178210564096:192.168.202.55@tcp:104: 00010000:00010000:3.0:1788309685.240266:0:16478:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c8f5548a00/0x63a04852f46298d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x63a04852f46298d0 expref: 18 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309685.240328:0:16478:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97c8f5548a00/0x63a04852f46298d7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x63a04852f46298d0 expref: 18 pid: 14357 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309685.240351:0:16478:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc91f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16478:1875178210564224:0@lo:104: 00000100:00100000:3.0:1788309685.240393:0:16478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788309685.240442:0:16478:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c8f5548000/0x63a04852f462979c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x63a04852f4629795 expref: 18 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309685.240451:0:16478:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97c8f5548000/0x63a04852f462979c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x63a04852f4629795 expref: 18 pid: 14356 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309685.240459:0:16478:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc91d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16478:1875178210564352:0@lo:104: 00000100:00100000:3.0:1788309685.240481:0:16478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788309685.240508:0:16478:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c8ecf2e600/0x63a04852f462974f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x63a04852f4629748 expref: 18 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309685.240516:0:16478:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97c8ecf2e600/0x63a04852f462974f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x63a04852f4629748 expref: 18 pid: 14357 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309685.240524:0:16478:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc91fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16478:1875178210564480:0@lo:104: 00000100:00100000:3.0:1788309685.240572:0:16478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309685.240584:0:16478:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8eff35cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788309685.244763:0:14346:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788309685.244797:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210564224 00000100:00100000:0.0:1788309685.244806:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210564224 00000100:00100000:0.0:1788309685.244850:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210564352 00000100:00100000:0.0:1788309685.244853:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210564352 00000100:00100000:0.0:1788309685.244864:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210564480 00000100:00100000:0.0:1788309685.244866:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210564480 00000100:00100000:0.0:1788309685.244882:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788309685.244892:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc91d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a1139bce-bc3d-41b1-9121-b11888b6dcf4+5:16478:x1875178210564224:12345-0@lo:104: 00010000:00010000:0.0:1788309685.244910:0:14346:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8600/0x63a04852f46298d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x63a04852f46298d7 expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309685.245002:0:14346:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788309685.245009:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc91d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a1139bce-bc3d-41b1-9121-b11888b6dcf4+5:16478:x1875178210564224:12345-0@lo:104: Request processed in 119us (4615us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309685.245016:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788309685.245032:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788309685.245038:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc91df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a1139bce-bc3d-41b1-9121-b11888b6dcf4+4:16478:x1875178210564352:12345-0@lo:104: 00010000:00010000:0.0:1788309685.245045:0:14346:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff97c8f5548400/0x63a04852f4629795 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x63a04852f462979c expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309685.245076:0:14346:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788309685.245081:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc91df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a1139bce-bc3d-41b1-9121-b11888b6dcf4+4:16478:x1875178210564352:12345-0@lo:104: Request processed in 44us (4600us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309685.245087:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788309685.245097:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788309685.245102:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6852450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a1139bce-bc3d-41b1-9121-b11888b6dcf4+3:16478:x1875178210564480:12345-0@lo:104: 00010000:00010000:0.0:1788309685.245125:0:14346:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff97c8fc935200/0x63a04852f4629748 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x63a04852f462974f expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309685.245154:0:14346:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788309685.245159:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6852450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a1139bce-bc3d-41b1-9121-b11888b6dcf4+3:16478:x1875178210564480:12345-0@lo:104: Request processed in 57us (4587us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309685.245165:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1788309685.245232:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788309685.245239:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8600/0x63a04852f46298d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x63a04852f46298d7 expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309685.245245:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d8600 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:0.0:1788309685.245250:0:14350:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8600/0x63a04852f46298d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x63a04852f46298d7 expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309685.245261:0:14350:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8600/0x63a04852f46298d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x63a04852f46298d7 expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788309685.245268:0:14350:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8600/0x63a04852f46298d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x63a04852f46298d7 expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788309685.245302:0:14350:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788309685.245355:0:14350:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8600/0x63a04852f46298d0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f46298d7 expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309685.245362:0:14350:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788309685.245384:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8600/0x63a04852f46298d0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f46298d7 expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309685.245391:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8600/0x63a04852f46298d0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f46298d7 expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309685.245415:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788309685.245419:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff97c8f5548400/0x63a04852f4629795 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x63a04852f462979c expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309685.245424:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8f5548400 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:0.0:1788309685.245427:0:14350:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff97c8f5548400/0x63a04852f4629795 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x63a04852f462979c expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309685.245434:0:14350:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff97c8f5548400/0x63a04852f4629795 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x63a04852f462979c expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788309685.245439:0:14350:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff97c8f5548400/0x63a04852f4629795 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x63a04852f462979c expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788309685.245445:0:14350:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788309685.245458:0:14350:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff97c8f5548400/0x63a04852f4629795 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f462979c expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309685.245464:0:14350:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788309685.245471:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff97c8f5548400/0x63a04852f4629795 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f462979c expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309685.245477:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff97c8f5548400/0x63a04852f4629795 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f462979c expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309685.245485:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788309685.245488:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff97c8fc935200/0x63a04852f4629748 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x63a04852f462974f expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309685.245505:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8fc935200 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:0.0:1788309685.245508:0:14350:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff97c8fc935200/0x63a04852f4629748 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x63a04852f462974f expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309685.245514:0:14350:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff97c8fc935200/0x63a04852f4629748 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x63a04852f462974f expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788309685.245520:0:14350:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff97c8fc935200/0x63a04852f4629748 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x63a04852f462974f expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788309685.245524:0:14350:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788309685.245549:0:14350:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff97c8fc935200/0x63a04852f4629748 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f462974f expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309685.245556:0:14350:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788309685.245828:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff97c8fc935200/0x63a04852f4629748 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f462974f expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309685.245835:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff97c8fc935200/0x63a04852f4629748 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63a04852f462974f expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309685.245850:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309685.245851:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309685.245853:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309685.245861:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788309685.245884:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffbb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a1139bce-bc3d-41b1-9121-b11888b6dcf4:3300:1875178210564608:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788309685.245928:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309685.245966:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788309685.245971:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffbb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a1139bce-bc3d-41b1-9121-b11888b6dcf4:3300:1875178210564736:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788309685.245999:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309685.246030:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffbb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a1139bce-bc3d-41b1-9121-b11888b6dcf4:3302:1875178210564864:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788309685.246054:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309685.246084:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210564608 00000100:00100000:0.0:1788309685.246089:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210564608 00010000:00010000:0.0:1788309685.246111:0:14349:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c8f5548a00/0x63a04852f46298d7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63a04852f46298d0 expref: 19 pid: 14357 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309685.246128:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210564736 00000100:00100000:0.0:1788309685.246131:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210564736 00010000:00010000:0.0:1788309685.246144:0:14349:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c8f5548000/0x63a04852f462979c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63a04852f4629795 expref: 20 pid: 14356 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309685.246155:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210564864 00000100:00100000:0.0:1788309685.246157:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210564864 00010000:00010000:0.0:1788309685.246166:0:14349:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c8ecf2e600/0x63a04852f462974f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63a04852f4629748 expref: 21 pid: 14357 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309685.246178:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788309685.246187:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffbb0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1139bce-bc3d-41b1-9121-b11888b6dcf4+21:3300:x1875178210564608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788309685.246196:0:14349:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788309685.246201:0:14349:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c8f5548a00/0x63a04852f46298d7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63a04852f46298d0 expref: 21 pid: 14357 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309685.246221:0:14349:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c8f5548a00/0x63a04852f46298d7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x63a04852f46298d0 expref: 21 pid: 14357 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309685.246237:0:14349:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788309685.246268:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffbb0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1139bce-bc3d-41b1-9121-b11888b6dcf4+21:3300:x1875178210564608:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309685.246305:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788309685.246335:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788309685.246343:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffbb0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1139bce-bc3d-41b1-9121-b11888b6dcf4+20:3300:x1875178210564736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788309685.246350:0:14349:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788309685.246355:0:14349:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c8f5548000/0x63a04852f462979c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63a04852f4629795 expref: 20 pid: 14356 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309685.246363:0:14349:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c8f5548000/0x63a04852f462979c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x63a04852f4629795 expref: 20 pid: 14356 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309685.246373:0:14349:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788309685.246395:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffbb0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1139bce-bc3d-41b1-9121-b11888b6dcf4+20:3300:x1875178210564736:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309685.246403:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788309685.246416:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788309685.246421:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffd9f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1139bce-bc3d-41b1-9121-b11888b6dcf4+19:3302:x1875178210564864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788309685.246427:0:14349:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788309685.246431:0:14349:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c8ecf2e600/0x63a04852f462974f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63a04852f4629748 expref: 19 pid: 14357 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309685.246438:0:14349:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c8ecf2e600/0x63a04852f462974f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x63a04852f4629748 expref: 19 pid: 14357 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309685.246446:0:14349:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788309685.246469:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffd9f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1139bce-bc3d-41b1-9121-b11888b6dcf4+19:3302:x1875178210564864:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309685.246475:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788309685.246540:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffbb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a1139bce-bc3d-41b1-9121-b11888b6dcf4:3302:1875178210564864:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788309685.247074:0:16478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c8f5548a00/0x63a04852f46298d7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x63a04852f46298d0 expref: 18 pid: 14357 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309685.247086:0:16478:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc91f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16478:1875178210564224:0@lo:104: 00010000:00010000:1.0:1788309685.247097:0:16478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c8f5548000/0x63a04852f462979c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x63a04852f4629795 expref: 17 pid: 14356 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309685.247104:0:16478:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc91d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16478:1875178210564352:0@lo:104: 00010000:00010000:1.0:1788309685.247113:0:16478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c8ecf2e600/0x63a04852f462974f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x63a04852f4629748 expref: 16 pid: 14357 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309685.247120:0:16478:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc91fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16478:1875178210564480:0@lo:104: 00000100:00100000:0.0:1788309685.247189:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffbb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a1139bce-bc3d-41b1-9121-b11888b6dcf4:3300:1875178210564736:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788309685.247197:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffbb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a1139bce-bc3d-41b1-9121-b11888b6dcf4:3300:1875178210564608:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788309685.248023:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309685.248057:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309685.248132:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192747008 00000100:00100000:2.0:1788309685.248140:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192747008 00010000:00010000:2.0:1788309685.248167:0:14348:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c8ecf2ea00/0x63a04852f46299f6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146adc7 expref: 13 pid: 14355 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309685.248198:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192746880 00000100:00100000:2.0:1788309685.248201:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192746880 00010000:00010000:2.0:1788309685.248223:0:14348:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c8e26d8800/0x63a04852f4629a2e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ae29 expref: 14 pid: 14355 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309685.248238:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 7 00000100:00100000:2.0:1788309685.248245:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e667f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b2082d80-0399-454d-94d0-622e1b077a92+14:2351:x1875178192747008:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788309685.248258:0:14348:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788309685.248263:0:14348:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c8ecf2ea00/0x63a04852f46299f6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146adc7 expref: 14 pid: 14355 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309685.248273:0:14348:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c8ecf2ea00/0x63a04852f46299f6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146adc7 expref: 14 pid: 14355 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309685.248311:0:14348:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788309685.248370:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e667f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b2082d80-0399-454d-94d0-622e1b077a92+14:2351:x1875178192747008:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 126us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309685.248377:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 7 00000100:00100000:2.0:1788309685.248394:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 8 00000100:00100000:2.0:1788309685.248400:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e667d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b2082d80-0399-454d-94d0-622e1b077a92+13:2351:x1875178192746880:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788309685.248421:0:14348:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788309685.248426:0:14348:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c8e26d8800/0x63a04852f4629a2e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ae29 expref: 13 pid: 14355 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309685.248436:0:14348:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c8e26d8800/0x63a04852f4629a2e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ae29 expref: 13 pid: 14355 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309685.248450:0:14348:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97c8c0031800/0x63a04852f4629a58 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309685.248458:0:14348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8c0031800/0x63a04852f4629a58 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309685.248485:0:14348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97c8c0031800/0x63a04852f4629a58 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309685.248492:0:14348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97c8c0031800/0x63a04852f4629a58 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309685.248498:0:14348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97c8c0031800/0x63a04852f4629a58 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309685.248505:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97c8c0031800/0x63a04852f4629a58 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309685.248510:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8c0031800 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:2.0:1788309685.248515:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97c8c0031800/0x63a04852f4629a58 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309685.248522:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97c8c0031800/0x63a04852f4629a58 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309685.248544:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97c8c0031800/0x63a04852f4629a58 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309685.248803:0:14348:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788309685.248830:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e667d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b2082d80-0399-454d-94d0-622e1b077a92+13:2351:x1875178192746880:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 429us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309685.248836:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 8 00010000:00010000:3.0:1788309685.250531:0:16478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c8e26d8800/0x63a04852f4629a2e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ae29 expref: 12 pid: 14355 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309685.250768:0:16478:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc91ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16478:1875178210563968:192.168.202.55@tcp:104: 00010000:00010000:3.0:1788309685.250822:0:16478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c8ecf2ea00/0x63a04852f46299f6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146adc7 expref: 11 pid: 14355 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309685.250832:0:16478:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc91f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16478:1875178210564096:192.168.202.55@tcp:104: 00010000:00010000:3.0:1788309685.250893:0:16478:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97c8c0031800/0x63a04852f4629a58 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309685.250902:0:16478:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97c8c0031800/0x63a04852f4629a58 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309685.250907:0:16478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97c8c0031800/0x63a04852f4629a58 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309685.250913:0:16478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c8c0031800/0x63a04852f4629a58 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309685.921390:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788309686.434131:0:14394:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788309686.917363:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309686.917459:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192747136 00000100:00100000:3.0:1788309686.917479:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192747136 00000100:00100000:3.0:1788309686.917573:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 106 00000100:00100000:3.0:1788309686.917590:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ee48d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2082d80-0399-454d-94d0-622e1b077a92+11:13746:x1875178192747136:12345-192.168.202.55@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788309686.917619:0:14356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309686.917652:0:14356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c8c0031800/0x63a04852f4629a5f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ae5a expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309686.917696:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8c0031800/0x63a04852f4629a5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ae5a expref: 12 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309686.917712:0:14356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c8c0031800/0x63a04852f4629a5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ae5a expref: 12 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309686.917724:0:14356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8c0031800, rc 0) 00000100:00100000:3.0:1788309686.917814:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ee48d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2082d80-0399-454d-94d0-622e1b077a92+12:13746:x1875178192747136:12345-192.168.202.55@tcp:101:ll_cfg_requeue.0 Request processed in 228us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309686.917845:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 106 00000100:00100000:2.0:1788309686.938482:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309686.940177:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192747264 00000100:00100000:3.0:1788309686.940206:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192747264 00000100:00100000:3.0:1788309686.940332:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 107 00000100:00100000:3.0:1788309686.940348:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ee48f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2082d80-0399-454d-94d0-622e1b077a92+12:13746:x1875178192747264:12345-192.168.202.55@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788309686.944581:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ee48f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2082d80-0399-454d-94d0-622e1b077a92+12:13746:x1875178192747264:12345-192.168.202.55@tcp:501:ll_cfg_requeue.0 Request processed in 4217us (6094us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309686.944603:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 107 00000100:00100000:1.0:1788309686.951951:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309686.952024:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192747392 00000100:00100000:1.0:1788309686.952056:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192747392 00000100:00100000:1.0:1788309686.952124:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 108 00000100:00100000:1.0:1788309686.952138:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ee53b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2082d80-0399-454d-94d0-622e1b077a92+12:13746:x1875178192747392:12345-192.168.202.55@tcp:503:ll_cfg_requeue.0 00010000:00010000:0.0:1788309686.953571:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788309686.953932:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ee53b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2082d80-0399-454d-94d0-622e1b077a92+12:13746:x1875178192747392:12345-192.168.202.55@tcp:503:ll_cfg_requeue.0 Request processed in 1167us (1375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309686.953947:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 108 00000100:00100000:1.0:1788309686.972620:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309686.973444:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192747520 00000100:00100000:3.0:1788309686.973461:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192747520 00000100:00100000:3.0:1788309686.973535:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 109 00000100:00100000:3.0:1788309686.973561:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ee538050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2082d80-0399-454d-94d0-622e1b077a92+12:13746:x1875178192747520:12345-192.168.202.55@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788309686.973585:0:14356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309686.973610:0:14356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c8c0031200/0x63a04852f4629a66 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ae61 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309686.973648:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8c0031200/0x63a04852f4629a66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ae61 expref: 13 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309686.973661:0:14356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c8c0031200/0x63a04852f4629a66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ae61 expref: 13 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309686.973674:0:14356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8c0031200, rc 0) 00000100:00100000:3.0:1788309686.973750:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ee538050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2082d80-0399-454d-94d0-622e1b077a92+13:13746:x1875178192747520:12345-192.168.202.55@tcp:101:ll_cfg_requeue.0 Request processed in 193us (1474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309686.973759:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 109 00000100:00100000:2.0:1788309687.022867:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309687.022956:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192747648 00000100:00100000:0.0:1788309687.022968:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192747648 00000100:00100000:0.0:1788309687.023033:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 110 00000100:00100000:0.0:1788309687.023048:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ee538c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2082d80-0399-454d-94d0-622e1b077a92+13:13746:x1875178192747648:12345-192.168.202.55@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788309687.023447:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ee538c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2082d80-0399-454d-94d0-622e1b077a92+13:13746:x1875178192747648:12345-192.168.202.55@tcp:501:ll_cfg_requeue.0 Request processed in 403us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309687.023456:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 110 00000100:00100000:3.0:1788309687.035668:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309687.035715:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192747776 00000100:00100000:3.0:1788309687.035727:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192747776 00000100:00100000:3.0:1788309687.035792:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 111 00000100:00100000:3.0:1788309687.035805:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ee539850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2082d80-0399-454d-94d0-622e1b077a92+13:13746:x1875178192747776:12345-192.168.202.55@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788309687.036186:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ee539850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2082d80-0399-454d-94d0-622e1b077a92+13:13746:x1875178192747776:12345-192.168.202.55@tcp:503:ll_cfg_requeue.0 Request processed in 382us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309687.036205:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 111 10000000:01000000:3.0:1788309687.136473:0:14360:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788309687.136484:0:14360:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97c8d93c7800 from 10 10000000:01000000:3.0:1788309687.136491:0:14360:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788309687.136761:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8c0031e00/0x63a04852f4629a6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309687.136777:0:14360:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff97c8c0031e00/0x63a04852f4629a6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309687.136793:0:14360:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff97c8c0031e00/0x63a04852f4629a6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309687.136828:0:14360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc91f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14360:1875178210564992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788309687.136951:0:14360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309687.137017:0:14360:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8eff35480 going to sleep for 11 seconds 00000100:00100000:2.0:1788309687.137102:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210564992 00000100:00100000:2.0:1788309687.137113:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210564992 00000100:00100000:2.0:1788309687.137200:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788309687.137213:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ee53bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1139bce-bc3d-41b1-9121-b11888b6dcf4+16:14360:x1875178210564992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788309687.137230:0:14356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309687.137250:0:14356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c8e26d8200/0x63a04852f4629a74 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x63a04852f4629a6d expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309687.137315:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8e26d8200/0x63a04852f4629a74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63a04852f4629a6d expref: 17 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309687.137331:0:14356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c8e26d8200/0x63a04852f4629a74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f4629a6d expref: 17 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309687.137343:0:14356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8e26d8200, rc 0) 00000100:00100000:2.0:1788309687.137407:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ee53bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1139bce-bc3d-41b1-9121-b11888b6dcf4+17:14360:x1875178210564992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 196us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309687.137416:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788309687.137543:0:14360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc91f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14360:1875178210564992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788309687.137565:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff97c8c0031e00/0x63a04852f4629a6d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4629a74 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309687.137576:0:14360:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff97c8c0031e00/0x63a04852f4629a6d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x63a04852f4629a74 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309687.137654:0:14360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e667df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14360:1875178210565120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788309687.137686:0:14360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309687.137723:0:14360:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8e684acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788309687.137804:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210565120 00000100:00100000:3.0:1788309687.137809:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210565120 00000100:00100000:3.0:1788309687.137847:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788309687.137855:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ee53a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1139bce-bc3d-41b1-9121-b11888b6dcf4+17:14360:x1875178210565120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788309687.138926:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ee53a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1139bce-bc3d-41b1-9121-b11888b6dcf4+17:14360:x1875178210565120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1067us (1234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309687.138940:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788309687.138970:0:14360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e667df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14360:1875178210565120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788309687.139023:0:14360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e667df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14360:1875178210565248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788309687.139073:0:14360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309687.139107:0:14360:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8e684acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788309687.139301:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210565248 00000100:00100000:2.0:1788309687.139308:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210565248 00000100:00100000:2.0:1788309687.139397:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788309687.139407:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ee538450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1139bce-bc3d-41b1-9121-b11888b6dcf4+17:14360:x1875178210565248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788309687.139609:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ee538450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1139bce-bc3d-41b1-9121-b11888b6dcf4+17:14360:x1875178210565248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 204us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309687.139616:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788309687.139991:0:14360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e667df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14360:1875178210565248:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788309687.141003:0:16547:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788309687.141367:0:14360:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788309687.141400:0:14360:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788309687.141419:0:14360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8c0031e00/0x63a04852f4629a6d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4629a74 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309687.141434:0:14360:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff97c8c0031e00/0x63a04852f4629a6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4629a74 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788309687.141446:0:14360:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788309687.141449:0:14360:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97c8d0dae800 from 10 10000000:01000000:2.0:1788309687.141452:0:14360:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788309687.141554:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8000/0x63a04852f4629a7b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309687.141564:0:14360:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8000/0x63a04852f4629a7b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309687.141577:0:14360:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8000/0x63a04852f4629a7b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309687.141619:0:14360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e6587800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14360:1875178210565376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788309687.141713:0:14360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309687.141762:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210565376 00000100:00100000:3.0:1788309687.141770:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210565376 00000100:00100000:3.0:1788309687.141824:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788309687.141837:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ee538850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1139bce-bc3d-41b1-9121-b11888b6dcf4+17:14360:x1875178210565376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788309687.141853:0:14355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309687.141869:0:14355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c8c0030a00/0x63a04852f4629a82 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x63a04852f4629a7b expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309687.141897:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8c0030a00/0x63a04852f4629a82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63a04852f4629a7b expref: 18 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309687.141909:0:14355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c8c0030a00/0x63a04852f4629a82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f4629a7b expref: 18 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309687.141919:0:14355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8c0030a00, rc 0) 00000100:00100000:3.0:1788309687.141959:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ee538850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1139bce-bc3d-41b1-9121-b11888b6dcf4+18:14360:x1875178210565376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309687.141966:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788309687.142219:0:14360:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c8967300 going to sleep for 11 seconds 00000100:00100000:2.0:1788309687.142247:0:14360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e6587800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14360:1875178210565376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788309687.142269:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8000/0x63a04852f4629a7b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4629a82 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309687.142301:0:14360:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8000/0x63a04852f4629a7b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x63a04852f4629a82 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309687.142360:0:14360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e6587800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14360:1875178210565504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788309687.142386:0:14360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309687.142411:0:14360:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c8967300 going to sleep for 11 seconds 00000100:00100000:1.0:1788309687.144266:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210565504 00000100:00100000:1.0:1788309687.144312:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210565504 00000100:00100000:1.0:1788309687.144382:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788309687.144410:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ee53b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1139bce-bc3d-41b1-9121-b11888b6dcf4+18:14360:x1875178210565504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788309687.144824:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ee53b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1139bce-bc3d-41b1-9121-b11888b6dcf4+18:14360:x1875178210565504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 416us (2434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309687.144832:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788309687.145248:0:14360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e6587800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14360:1875178210565504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788309687.145342:0:14360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc91ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14360:1875178210565632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788309687.145411:0:14360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309687.145453:0:14360:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8eff353c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788309687.145473:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210565632 00000100:00100000:3.0:1788309687.145480:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210565632 00000100:00100000:3.0:1788309687.145543:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788309687.145553:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ee53b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1139bce-bc3d-41b1-9121-b11888b6dcf4+18:14360:x1875178210565632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788309687.145776:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ee53b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1139bce-bc3d-41b1-9121-b11888b6dcf4+18:14360:x1875178210565632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 224us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309687.145835:0:14360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc91ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14360:1875178210565632:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788309687.150294:0:16548:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788309687.150431:0:14360:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788309687.150452:0:14360:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788309687.150467:0:14360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8000/0x63a04852f4629a7b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4629a82 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309687.150481:0:14360:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8000/0x63a04852f4629a7b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4629a82 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788309687.150495:0:14360:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788309687.150498:0:14360:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97c8ffb11000 from 10 10000000:01000000:2.0:1788309687.150501:0:14360:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788309687.150553:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8a00/0x63a04852f4629a89 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309687.150579:0:14360:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8a00/0x63a04852f4629a89 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309687.150596:0:14360:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8a00/0x63a04852f4629a89 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309687.150631:0:14360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e6587b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14360:1875178210565760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788309687.150719:0:14360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309687.150772:0:14360:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c8967480 going to sleep for 11 seconds 00000100:00100000:1.0:1788309687.154044:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210565760 00000100:00100000:1.0:1788309687.154065:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210565760 00000100:00100000:1.0:1788309687.154120:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788309687.154131:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ee539450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1139bce-bc3d-41b1-9121-b11888b6dcf4+19:14360:x1875178210565760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788309687.154153:0:14355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788309687.154179:0:14355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c8f5549800/0x63a04852f4629a90 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x63a04852f4629a89 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309687.154226:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c8f5549800/0x63a04852f4629a90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63a04852f4629a89 expref: 20 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309687.154239:0:14355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c8f5549800/0x63a04852f4629a90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63a04852f4629a89 expref: 20 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309687.154250:0:14355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8f5549800, rc 0) 00000100:00100000:3.0:1788309687.154794:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788309687.160531:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ee539450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1139bce-bc3d-41b1-9121-b11888b6dcf4+19:14360:x1875178210565760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 6385us (9795us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309687.160551:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788309687.182732:0:14360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e6587b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14360:1875178210565760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788309687.182773:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8a00/0x63a04852f4629a89 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4629a90 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309687.182791:0:14360:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8a00/0x63a04852f4629a89 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x63a04852f4629a90 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309687.183428:0:14360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc91fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14360:1875178210565888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788309687.183515:0:14360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309687.183564:0:14360:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8eff35180 going to sleep for 11 seconds 00000100:00100000:0.0:1788309687.184645:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210565888 00000100:00100000:0.0:1788309687.184658:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210565888 00000100:00100000:0.0:1788309687.184731:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788309687.184744:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ee53ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1139bce-bc3d-41b1-9121-b11888b6dcf4+19:14360:x1875178210565888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788309687.185135:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ee53ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1139bce-bc3d-41b1-9121-b11888b6dcf4+19:14360:x1875178210565888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 392us (1619us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309687.185158:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788309687.185336:0:14360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc91fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14360:1875178210565888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788309687.185396:0:14360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc91fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14360:1875178210566016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788309687.185450:0:14360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309687.185484:0:14360:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8eff35180 going to sleep for 11 seconds 00000100:00100000:2.0:1788309687.185935:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210566016 00000100:00100000:2.0:1788309687.185942:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210566016 00000100:00100000:2.0:1788309687.185982:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788309687.185991:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ee539050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1139bce-bc3d-41b1-9121-b11888b6dcf4+19:14360:x1875178210566016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788309687.186199:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ee539050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1139bce-bc3d-41b1-9121-b11888b6dcf4+19:14360:x1875178210566016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 209us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309687.186207:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788309687.186411:0:14360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc91fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1139bce-bc3d-41b1-9121-b11888b6dcf4:14360:1875178210566016:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788309687.187665:0:16550:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788309687.188145:0:14360:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788309687.188167:0:14360:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788309687.188181:0:14360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8a00/0x63a04852f4629a89 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4629a90 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309687.188205:0:14360:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff97c8e26d8a00/0x63a04852f4629a89 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x63a04852f4629a90 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309687.777473:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc91fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210566144:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788309687.777570:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309687.777659:0:15048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210566144 00000100:00100000:1.0:1788309687.777669:0:15048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210566144 00000100:00100000:1.0:1788309687.777737:0:15048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788309687.777748:0:15048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc91d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210566144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788309687.777807:0:15048:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788309687.777876:0:15048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc91d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875178210566144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 129us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309687.777892:0:15048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1788309687.777919:0:14358:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788309687.777963:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc91fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875178210566144:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788309687.780132:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e667c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210566400:0@lo:400:kworker.0 00000100:00100000:3.0:1788309687.780219:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e667df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a1139bce-bc3d-41b1-9121-b11888b6dcf4:3300:1875178210566272:0@lo:400:kworker.0 00000100:00100000:3.0:1788309687.780262:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309687.780331:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e667ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875178210566784:0@lo:400:kworker.0 00000100:00100000:3.0:1788309687.780360:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309687.780433:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210566272 00000100:00100000:3.0:1788309687.780444:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210566272 00000100:00100000:1.0:1788309687.780447:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309687.780515:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788309687.780530:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ee53a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1139bce-bc3d-41b1-9121-b11888b6dcf4+19:3300:x1875178210566272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309687.780561:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210566784 00000100:00100000:1.0:1788309687.780574:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210566784 00000100:00100000:3.0:1788309687.780604:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ee53a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1139bce-bc3d-41b1-9121-b11888b6dcf4+19:3300:x1875178210566272:12345-0@lo:400:kworker.0 Request processed in 77us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309687.780613:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788309687.780662:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788309687.780680:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc91f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875178210566784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309687.780688:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e667df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a1139bce-bc3d-41b1-9121-b11888b6dcf4:3300:1875178210566272:0@lo:400:kworker.0 00000100:00100000:1.0:1788309687.780783:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc91f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875178210566784:12345-0@lo:400:kworker.0 Request processed in 108us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309687.780792:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788309687.780824:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e667ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875178210566784:0@lo:400:kworker.0 00000100:00100000:1.0:1788309687.780835:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210566400 00000100:00100000:1.0:1788309687.780842:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210566400 00000100:00100000:1.0:1788309687.780886:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788309687.780896:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e667e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1875178210566400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309687.780946:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e667e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1875178210566400:12345-0@lo:400:kworker.0 Request processed in 52us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309687.780953:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788309687.780989:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e667c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210566400:0@lo:400:kworker.0 00000100:00100000:1.0:1788309687.780998:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e667ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875178210566528:0@lo:400:kworker.0 00000100:00100000:1.0:1788309687.781036:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309687.781064:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788309687.781074:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e667d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875178210566656:0@lo:400:kworker.0 00000100:00100000:3.0:1788309687.781086:0:15347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210566528 00000100:00100000:3.0:1788309687.781094:0:15347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210566528 00000100:00100000:1.0:1788309687.781104:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309687.781140:0:15347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210566656 00000100:00100000:3.0:1788309687.781146:0:15347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210566656 00000100:00100000:1.0:1788309687.781155:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788309687.781196:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e667ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875178210566528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309687.781237:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e667ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875178210566528:12345-0@lo:400:kworker.0 Request processed in 57us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309687.782829:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788309687.782859:0:15347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788309687.782880:0:15347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e667e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875178210566656:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788309687.782889:0:14358:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788309687.782899:0:14358:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788309687.782947:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e667ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875178210566528:0@lo:400:kworker.0 00000100:00100000:3.0:1788309687.782989:0:15347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e667e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875178210566656:12345-0@lo:400:kworker.0 Request processed in 116us (1883us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309687.782997:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e667d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875178210566656:0@lo:400:kworker.0 00000100:00100000:3.0:1788309687.783005:0:15347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:3.0:1788309687.968687:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788309688.266138:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309688.266206:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309688.266246:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309688.266307:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309688.266328:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309688.266348:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309688.266373:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309688.266409:0:15047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192748160 00000100:00100000:1.0:1788309688.266423:0:15047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192748160 00000100:00100000:1.0:1788309688.266492:0:15047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192748672 00000100:00100000:1.0:1788309688.266495:0:15047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192748672 00000100:00100000:1.0:1788309688.266510:0:15047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192748288 00000100:00100000:1.0:1788309688.266513:0:15047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192748288 00000100:00100000:1.0:1788309688.266543:0:15047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192748544 00000100:00100000:1.0:1788309688.266546:0:15047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192748544 00000100:00100000:1.0:1788309688.266565:0:15047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 12 00000100:00100000:1.0:1788309688.266576:0:15047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e667d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+5:2350:x1875178192748160:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788309688.266675:0:15047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e667d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+5:2350:x1875178192748160:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 99us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309688.266707:0:15047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 12 00000100:00100000:1.0:1788309688.266729:0:15047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 13 00000100:00100000:1.0:1788309688.266736:0:15047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e667dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:58cbd1af-e5b9-4e74-a0c2-c243cb2213cd+5:2350:x1875178192748672:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788309688.266763:0:15047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e667dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:58cbd1af-e5b9-4e74-a0c2-c243cb2213cd+5:2350:x1875178192748672:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 28us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309688.266770:0:15047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 13 00000100:00100000:1.0:1788309688.266780:0:15047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 14 00000100:00100000:1.0:1788309688.266786:0:15047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e667d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+5:2350:x1875178192748288:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788309688.266808:0:15047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e667d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+5:2350:x1875178192748288:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 22us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309688.266815:0:15047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 14 00000100:00100000:1.0:1788309688.266826:0:15047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 15 00000100:00100000:1.0:1788309688.266832:0:15047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e667c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:58cbd1af-e5b9-4e74-a0c2-c243cb2213cd+5:2350:x1875178192748544:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788309688.266867:0:15047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e667c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:58cbd1af-e5b9-4e74-a0c2-c243cb2213cd+5:2350:x1875178192748544:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 35us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309688.266873:0:15047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 15 00000100:00080000:1.0:1788309688.266896:0:14358:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788309688.266901:0:14358:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788309688.266917:0:15347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192748416 00000100:00100000:1.0:1788309688.266921:0:15347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192748416 00000100:00100000:1.0:1788309688.266954:0:15347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192748032 00000100:00100000:1.0:1788309688.266957:0:15347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192748032 00000100:00100000:1.0:1788309688.266978:0:15347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 27 00000100:00100000:1.0:1788309688.266985:0:15347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e667ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58cbd1af-e5b9-4e74-a0c2-c243cb2213cd+6:2350:x1875178192748416:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788309688.267037:0:15347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e667ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58cbd1af-e5b9-4e74-a0c2-c243cb2213cd+6:2350:x1875178192748416:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 52us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309688.267045:0:15347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 27 00000100:00100000:1.0:1788309688.267057:0:15347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 28 00000100:00100000:1.0:1788309688.267063:0:15347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e667c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+6:2350:x1875178192748032:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788309688.267086:0:15347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e667c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+6:2350:x1875178192748032:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 23us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309688.267092:0:15347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 28 00000100:00080000:1.0:1788309688.267106:0:14358:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788309688.270986:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192747904 00000100:00100000:2.0:1788309688.271006:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192747904 00000100:00100000:2.0:1788309688.271130:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 122 00000100:00100000:2.0:1788309688.271155:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ee53a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2082d80-0399-454d-94d0-622e1b077a92+13:2350:x1875178192747904:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:2.0:1788309688.271316:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ee53a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2082d80-0399-454d-94d0-622e1b077a92+13:2350:x1875178192747904:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 122us (5156us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309688.271322:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 122 00010000:00010000:0.0:1788309688.996666:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788309689.153624:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309689.153877:0:15347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192748800 00000100:00100000:3.0:1788309689.153899:0:15347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192748800 00000100:00100000:3.0:1788309689.154001:0:15347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 15 00000100:00100000:3.0:1788309689.154012:0:15347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e667ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+6:14405:x1875178192748800:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788309689.154032:0:15347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309689.154053:0:15347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f4629a97 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ae68 expref: -99 pid: 15347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309689.154147:0:15347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4629a9e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309689.154162:0:15347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4629a9e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309689.154182:0:15347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4629a9e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309689.154198:0:15347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f4629aa5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309689.154205:0:15347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f4629aa5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309689.154212:0:15347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f4629aa5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309689.156714:0:15347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef400/0x63a04852f4629aac lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309689.156736:0:15347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef400/0x63a04852f4629aac lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309689.156747:0:15347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef400/0x63a04852f4629aac lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788309689.156863:0:15347:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1788309689.156868:0:15347:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1788309689.156970:0:15347:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef400/0x63a04852f4629aac lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309689.156996:0:15347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4629a9e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309689.157003:0:15347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4629a9e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309689.157011:0:15347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4629a9e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309689.157018:0:15347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8d73eee00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:3.0:1788309689.157023:0:15347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4629a9e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309689.157031:0:15347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4629a9e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309689.157046:0:15347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c902070400) 00010000:00010000:3.0:1788309689.157049:0:15347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788309689.157053:0:15347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4629a9e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309689.157060:0:15347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4629a9e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309689.157087:0:15347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f4629aa5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309689.157094:0:15347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f4629aa5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309689.157098:0:15347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f4629aa5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309689.157110:0:15347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8d73ee400 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:3.0:1788309689.157113:0:15347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f4629aa5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309689.157119:0:15347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f4629aa5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309689.157127:0:15347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff97c902070000) 00010000:00010000:3.0:1788309689.157129:0:15347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788309689.157132:0:15347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f4629aa5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309689.157137:0:15347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f4629aa5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309689.157186:0:15347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f4629a97 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ae68 expref: 8 pid: 15347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309689.157203:0:15347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef400/0x63a04852f4629aac lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ae68 expref: 7 pid: 15347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309689.157211:0:15347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff97c902070f00) 00010000:00010000:3.0:1788309689.157213:0:15347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788309689.157216:0:15347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8d73ef400, rc 0) 00000100:00100000:3.0:1788309689.157338:0:15347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e667ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+7:14405:x1875178192748800:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 3327us (3724us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309689.157348:0:15347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 15 00000100:00100000:0.0:1788309689.166127:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309689.166624:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192749056 00000100:00100000:1.0:1788309689.166636:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192749056 00000100:00100000:1.0:1788309689.166701:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 16 00000100:00100000:1.0:1788309689.166711:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffbb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+7:14405:x1875178192749056:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788309689.166732:0:14364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788309689.166756:0:14364:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f4629ab3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ae6f expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309689.166832:0:14364:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548200/0x63a04852f4629aba lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309689.166847:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548200/0x63a04852f4629aba lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309689.166860:0:14364:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548200/0x63a04852f4629aba lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309689.166939:0:14364:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548600/0x63a04852f4629ac1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309689.166947:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548600/0x63a04852f4629ac1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309689.166954:0:14364:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548600/0x63a04852f4629ac1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309689.168018:0:14364:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548a00/0x63a04852f4629ac8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309689.168034:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548a00/0x63a04852f4629ac8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309689.168041:0:14364:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548a00/0x63a04852f4629ac8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788309689.168061:0:14364:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1788309689.168394:0:14364:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548200/0x63a04852f4629aba lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309689.168402:0:14364:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548200/0x63a04852f4629aba lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309689.168409:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548200/0x63a04852f4629aba lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309689.168415:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8f5548200 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:1.0:1788309689.168419:0:14364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548200/0x63a04852f4629aba lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309689.168438:0:14364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548200/0x63a04852f4629aba lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309689.168453:0:14364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff97c902070f00) 00010000:00010000:1.0:1788309689.168457:0:14364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788309689.168462:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548200/0x63a04852f4629aba lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309689.168469:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548200/0x63a04852f4629aba lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309689.168485:0:14364:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548600/0x63a04852f4629ac1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309689.168490:0:14364:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548600/0x63a04852f4629ac1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309689.168497:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548600/0x63a04852f4629ac1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309689.168503:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8f5548600 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:1.0:1788309689.168505:0:14364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548600/0x63a04852f4629ac1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309689.168511:0:14364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548600/0x63a04852f4629ac1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309689.168519:0:14364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff97c8d832f800) 00010000:00010000:1.0:1788309689.168532:0:14364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788309689.168535:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548600/0x63a04852f4629ac1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309689.168552:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548600/0x63a04852f4629ac1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309689.168973:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f4629ab3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ae6f expref: 10 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309689.168991:0:14364:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548a00/0x63a04852f4629ac8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ae6f expref: 9 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309689.168998:0:14364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97c8d832fc00) 00010000:00010000:1.0:1788309689.169000:0:14364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788309689.169003:0:14364:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8f5548a00, rc 0) 00000100:00100000:1.0:1788309689.169088:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffbb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+9:14405:x1875178192749056:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 2377us (2972us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788309689.169097:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 16 00000100:00100000:2.0:1788309689.187143:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309689.187358:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192749184 00000100:00100000:1.0:1788309689.187368:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192749184 00000100:00100000:1.0:1788309689.187441:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 17 00000100:00100000:1.0:1788309689.187453:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6585c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+9:14405:x1875178192749184:12345-192.168.202.55@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788309689.187585:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6585c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+9:14405:x1875178192749184:12345-192.168.202.55@tcp:59:lhsmtool_posix.0 Request processed in 134us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309689.187593:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 17 00000100:00100000:2.0:1788309689.253694:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309689.253788:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192749312 00000100:00100000:3.0:1788309689.253814:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192749312 00000100:00100000:3.0:1788309689.253874:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 18 00000100:00100000:3.0:1788309689.253895:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6584e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+9:14411:x1875178192749312:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:3.0:1788309689.253916:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309689.253938:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f4629ad6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ae76 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309689.254000:0:14362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f4629add lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309689.254014:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f4629add lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309689.254027:0:14362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f4629add lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309689.254041:0:14362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4629ae4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309689.254048:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4629ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309689.254054:0:14362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4629ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309689.254474:0:14362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f4629add lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309689.254484:0:14362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f4629add lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309689.254491:0:14362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f4629add lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309689.254502:0:14362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8d73ee400 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:3.0:1788309689.254506:0:14362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f4629add lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309689.254514:0:14362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f4629add lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309689.254527:0:14362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c902070400) 00010000:00010000:3.0:1788309689.254530:0:14362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788309689.254535:0:14362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f4629add lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309689.254540:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f4629add lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309689.254552:0:14362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4629ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309689.254558:0:14362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4629ae4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309689.254565:0:14362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4629ae4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309689.254570:0:14362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8d73eee00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:3.0:1788309689.254573:0:14362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4629ae4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309689.254578:0:14362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4629ae4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309689.254597:0:14362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff97c902070000) 00010000:00010000:3.0:1788309689.254599:0:14362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788309689.254602:0:14362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4629ae4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309689.254607:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4629ae4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309689.254639:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f4629ad6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ae76 expref: 10 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309689.254649:0:14362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c902070400) 00010000:00010000:3.0:1788309689.254651:0:14362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788309689.254654:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f4629ad6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ae76 expref: 10 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309689.254662:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8d73ef800, rc 0) 00000100:00100000:3.0:1788309689.254724:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6584e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+9:14411:x1875178192749312:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 840us (1040us total) trans 0 rc 301/301 00000100:00100000:3.0:1788309689.254732:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 18 00000100:00100000:0.0:1788309689.263422:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309689.263558:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192749440 00000100:00100000:1.0:1788309689.263569:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192749440 00000100:00100000:1.0:1788309689.263628:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 0 00000100:00100000:1.0:1788309689.263639:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffbb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+9:14411:x1875178192749440:12345-192.168.202.55@tcp:700:lfs.0 00000100:00100000:1.0:1788309689.263743:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffbb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+9:14411:x1875178192749440:12345-192.168.202.55@tcp:700:lfs.0 Request processed in 105us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309689.263751:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 0 00000100:00100000:2.0:1788309689.267205:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309689.267445:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192749696 00000100:00100000:1.0:1788309689.267456:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192749696 00000100:00100000:1.0:1788309689.267532:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 19 00000100:00100000:1.0:1788309689.267543:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6585f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+9:14411:x1875178192749696:12345-192.168.202.55@tcp:36:lfs.0 00010000:00010000:1.0:1788309689.267603:0:14363:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788309689.267633:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c0030e00/0x63a04852f4629a19 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146adf1 expref: 9 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309689.267669:0:14363:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c902070400) 00010000:00010000:1.0:1788309689.267675:0:14363:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788309689.267960:0:14363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f4629aeb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309689.267975:0:14363:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c0030400/0x63a04852f4629a51 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ae53 expref: 5 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309689.267984:0:14363:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f4629aeb lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309689.268020:0:14363:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c0030400/0x63a04852f4629a51 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ae53 expref: 5 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309689.268034:0:14363:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c0030400/0x63a04852f4629a51 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ae53 expref: 5 pid: 14362 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309689.268062:0:14363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8e667df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14363:1875178210566912:192.168.202.55@tcp:104: 00000100:00100000:1.0:1788309689.268166:0:14363:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8e6a690c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788309689.277869:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309689.278138:0:14363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8e667df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14363:1875178210566912:192.168.202.55@tcp:104: 00010000:00010000:1.0:1788309689.278165:0:14363:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f4629aeb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309689.278411:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192749824 00000100:00100000:0.0:1788309689.278418:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192749824 00010000:00010000:0.0:1788309689.278456:0:14348:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c0030400/0x63a04852f4629a51 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ae53 expref: 6 pid: 14362 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309689.278509:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 9 00000100:00100000:0.0:1788309689.278519:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6586300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58cbd1af-e5b9-4e74-a0c2-c243cb2213cd+6:2350:x1875178192749824:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788309689.278543:0:14348:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788309689.278550:0:14348:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c0030400/0x63a04852f4629a51 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ae53 expref: 6 pid: 14362 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309689.278563:0:14348:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c0030400/0x63a04852f4629a51 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ae53 expref: 6 pid: 14362 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309689.278587:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8c0030400/0x63a04852f4629a51 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ae53 expref: 6 pid: 14362 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309689.278618:0:14348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c902070400) 00010000:00010000:0.0:1788309689.278624:0:14348:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f4629aeb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309689.278633:0:14348:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f4629aeb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309689.278640:0:14348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f4629aeb lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309689.278671:0:14348:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788309689.278730:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6586300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58cbd1af-e5b9-4e74-a0c2-c243cb2213cd+5:2350:x1875178192749824:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 213us (874us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309689.278738:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 9 00010000:00010000:2.0:1788309689.279969:0:14363:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f4629aeb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.279982:0:14363:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f4629aeb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.280011:0:14363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9200/0x63a04852f4629af2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.280023:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9200/0x63a04852f4629af2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.280032:0:14363:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9200/0x63a04852f4629af2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788309689.283937:0:14363:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1788309689.283957:0:14363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f4629aeb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.283968:0:14363:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f4629aeb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.283976:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f4629aeb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.283995:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8f5548800 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309689.284000:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f4629aeb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.284007:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f4629aeb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.284026:0:14363:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c902070400) 00010000:00010000:2.0:1788309689.284029:0:14363:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788309689.284033:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f4629aeb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.284039:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548800/0x63a04852f4629aeb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788309689.284062:0:14363:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ae1e0a66 reply state 00000000fb8190e2 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9200/0x63a04852f4629af2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309689.284071:0:14363:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788309689.284224:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6585f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+10:14411:x1875178192749696:12345-192.168.202.55@tcp:36:lfs.0 Request processed in 16679us (17025us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788309689.284234:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 19 00010000:00010000:3.0:1788309689.293351:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9200/0x63a04852f4629af2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309689.293371:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9200/0x63a04852f4629af2 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309689.293378:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9200/0x63a04852f4629af2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309689.293403:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d9200 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:3.0:1788309689.293409:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9200/0x63a04852f4629af2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309689.293417:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9200/0x63a04852f4629af2 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309689.293435:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff97c8d83f4b00) 00010000:00010000:3.0:1788309689.293439:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788309689.293443:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9200/0x63a04852f4629af2 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309689.293450:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9200/0x63a04852f4629af2 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309689.440863:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309689.441145:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192749952 00000100:00100000:1.0:1788309689.441163:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192749952 00000100:00100000:1.0:1788309689.441264:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 20 00000100:00100000:1.0:1788309689.441298:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc91fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+9:14419:x1875178192749952:12345-192.168.202.55@tcp:101:lctl.0 00010000:00010000:1.0:1788309689.441324:0:14364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788309689.441347:0:14364:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548600/0x63a04852f4629af9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ae7d expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309689.441414:0:14364:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548200/0x63a04852f4629b00 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309689.441428:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548200/0x63a04852f4629b00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309689.441440:0:14364:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548200/0x63a04852f4629b00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788309689.441513:0:14364:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1788309689.441517:0:14364:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:1.0:1788309689.441561:0:14364:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548200/0x63a04852f4629b00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309689.441607:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548600/0x63a04852f4629af9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ae7d expref: 11 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309689.441626:0:14364:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548200/0x63a04852f4629b00 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ae7d expref: 10 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309689.441633:0:14364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c8d832f800) 00010000:00010000:1.0:1788309689.441636:0:14364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788309689.441639:0:14364:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8f5548200, rc 0) 00000100:00100000:1.0:1788309689.441711:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc91fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+10:14419:x1875178192749952:12345-192.168.202.55@tcp:101:lctl.0 Request processed in 437us (865us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309689.441718:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 20 00000100:00100000:2.0:1788309689.487155:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309689.487261:0:15347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192750080 00000100:00100000:3.0:1788309689.487343:0:15347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192750080 00000100:00100000:3.0:1788309689.487435:0:15347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 21 00000100:00100000:3.0:1788309689.487448:0:15347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6587100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58cbd1af-e5b9-4e74-a0c2-c243cb2213cd+5:14420:x1875178192750080:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:3.0:1788309689.487908:0:15347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309689.487940:0:15347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f4629b07 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ae84 expref: -99 pid: 15347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309689.488035:0:15347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4629b0e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309689.488052:0:15347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4629b0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309689.488086:0:15347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4629b0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788309689.488255:0:15347:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1788309689.488260:0:15347:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1788309689.488336:0:15347:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4629b0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309689.488370:0:15347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f4629b07 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ae84 expref: 7 pid: 15347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309689.488394:0:15347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eee00/0x63a04852f4629b0e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ae84 expref: 6 pid: 15347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309689.488405:0:15347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c8d832f800) 00010000:00010000:3.0:1788309689.488408:0:15347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788309689.488413:0:15347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8d73eee00, rc 0) 00000100:00100000:3.0:1788309689.488837:0:15347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6587100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58cbd1af-e5b9-4e74-a0c2-c243cb2213cd+6:14420:x1875178192750080:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 1388us (1689us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309689.488847:0:15347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 21 00000100:00100000:0.0:1788309689.506833:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000040:00080000:1.0:1788309689.507389:0:14394:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788309689.509652:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192750208 00000100:00100000:2.0:1788309689.509670:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192750208 00000100:00100000:2.0:1788309689.509749:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 22 00000100:00100000:2.0:1788309689.509759:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffbb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58cbd1af-e5b9-4e74-a0c2-c243cb2213cd+6:14420:x1875178192750208:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:2.0:1788309689.509786:0:14364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309689.509812:0:14364:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9800/0x63a04852f4629b15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ae8b expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.509915:0:14364:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9e00/0x63a04852f4629b1c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.509928:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9e00/0x63a04852f4629b1c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.509938:0:14364:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9e00/0x63a04852f4629b1c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.509950:0:14364:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4629b23 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.509955:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4629b23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.509959:0:14364:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4629b23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.518037:0:14364:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4629b2a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.518065:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4629b2a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.518078:0:14364:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4629b2a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788309689.518162:0:14364:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1788309689.518177:0:14364:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788309689.518207:0:14364:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4629b2a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.518243:0:14364:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9e00/0x63a04852f4629b1c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.518250:0:14364:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9e00/0x63a04852f4629b1c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.518256:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9e00/0x63a04852f4629b1c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.518262:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d9e00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309689.518267:0:14364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9e00/0x63a04852f4629b1c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.518274:0:14364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9e00/0x63a04852f4629b1c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.518307:0:14364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c8d832f800) 00010000:00010000:2.0:1788309689.518311:0:14364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788309689.518316:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9e00/0x63a04852f4629b1c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.518322:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9e00/0x63a04852f4629b1c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.518341:0:14364:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4629b23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.518347:0:14364:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4629b23 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.518353:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4629b23 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.518364:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d9c00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309689.518368:0:14364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4629b23 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.518374:0:14364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4629b23 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.518383:0:14364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff97c8d83f4600) 00010000:00010000:2.0:1788309689.518386:0:14364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788309689.518389:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4629b23 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.518395:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4629b23 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.518439:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9800/0x63a04852f4629b15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ae8b expref: 8 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.518455:0:14364:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4629b2a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ae8b expref: 7 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.518462:0:14364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff97c8d83f4a00) 00010000:00010000:2.0:1788309689.518464:0:14364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788309689.518467:0:14364:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8e26d9a00, rc 0) 00000100:00100000:2.0:1788309689.518554:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffbb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58cbd1af-e5b9-4e74-a0c2-c243cb2213cd+7:14420:x1875178192750208:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 8794us (11740us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309689.518564:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 22 00000100:00100000:2.0:1788309689.542677:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309689.543459:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192750464 00000100:00100000:1.0:1788309689.543471:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192750464 00000100:00100000:1.0:1788309689.543543:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 23 00000100:00100000:1.0:1788309689.543555:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6584700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58cbd1af-e5b9-4e74-a0c2-c243cb2213cd+7:14420:x1875178192750464:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:1.0:1788309689.543577:0:14363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788309689.543599:0:14363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4629b31 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ae92 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788309689.544138:0:14363:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1788309689.544342:0:14363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4629b31 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ae92 expref: 9 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309689.544359:0:14363:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c8d832f800) 00010000:00010000:1.0:1788309689.544433:0:14363:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788309689.544441:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4629b31 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ae92 expref: 9 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309689.544459:0:14363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8f5548000, rc 0) 00000100:00100000:1.0:1788309689.544593:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6584700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58cbd1af-e5b9-4e74-a0c2-c243cb2213cd+8:14420:x1875178192750464:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 1040us (1927us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1788309689.544602:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 23 00000100:00100000:1.0:1788309689.549231:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309689.551144:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192750720 00000100:00100000:0.0:1788309689.551158:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192750720 00000100:00100000:0.0:1788309689.551232:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 24 00000100:00100000:0.0:1788309689.551243:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e667df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58cbd1af-e5b9-4e74-a0c2-c243cb2213cd+8:14420:x1875178192750720:12345-192.168.202.55@tcp:36:lfs.0 00010000:00010000:0.0:1788309689.551322:0:14362:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788309689.551353:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4629b2a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ae8b expref: 8 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309689.551377:0:14362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff97c8d83f4a00) 00010000:00010000:0.0:1788309689.551388:0:14362:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788309689.551417:0:14362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e400/0x63a04852f4629b3f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309689.551429:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e400/0x63a04852f4629b3f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309689.551439:0:14362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e400/0x63a04852f4629b3f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788309689.551697:0:14362:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007684e0fd reply state 000000009e879e6c transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e400/0x63a04852f4629b3f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309689.551707:0:14362:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788309689.551721:0:14362:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:0.0:1788309689.555445:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e667df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58cbd1af-e5b9-4e74-a0c2-c243cb2213cd+9:14420:x1875178192750720:12345-192.168.202.55@tcp:36:lfs.0 Request processed in 3729us (5750us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1788309689.555462:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 24 00000100:00100000:1.0:1788309689.567060:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00010000:00010000:0.0:1788309689.567506:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e400/0x63a04852f4629b3f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309689.567558:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e400/0x63a04852f4629b3f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309689.567567:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e400/0x63a04852f4629b3f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309689.567574:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8ecf2e400 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:0.0:1788309689.567580:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e400/0x63a04852f4629b3f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309689.567590:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e400/0x63a04852f4629b3f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309689.567615:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff97c8c2ab9d00) 00010000:00010000:0.0:1788309689.567619:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1788309689.567624:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e400/0x63a04852f4629b3f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309689.567631:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e400/0x63a04852f4629b3f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309689.568926:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192750976 00000100:00100000:2.0:1788309689.568944:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192750976 00000100:00100000:2.0:1788309689.569026:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 2 00000100:00100000:2.0:1788309689.569040:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e667ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58cbd1af-e5b9-4e74-a0c2-c243cb2213cd+8:14420:x1875178192750976:12345-192.168.202.55@tcp:35:lfs.0 00000100:00100000:2.0:1788309689.569487:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e667ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58cbd1af-e5b9-4e74-a0c2-c243cb2213cd+9:14420:x1875178192750976:12345-192.168.202.55@tcp:35:lfs.0 Request processed in 449us (2449us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1788309689.569496:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 2 00000100:00100000:2.0:1788309689.576614:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309689.576793:0:15347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192751232 00000100:00100000:3.0:1788309689.576807:0:15347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192751232 00000100:00100000:3.0:1788309689.576893:0:15347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 25 00000100:00100000:3.0:1788309689.576908:0:15347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6586d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58cbd1af-e5b9-4e74-a0c2-c243cb2213cd+9:14420:x1875178192751232:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:3.0:1788309689.576944:0:15347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309689.576973:0:15347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f4629b46 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146ae99 expref: -99 pid: 15347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309689.577241:0:15347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f4629b4d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309689.577261:0:15347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f4629b4d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309689.577466:0:15347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f4629b4d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.577624:0:15347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4629b54 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.577634:0:15347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4629b54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.577642:0:15347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4629b54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788309689.577820:0:15347:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1788309689.577942:0:15347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f4629b4d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.577950:0:15347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f4629b4d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.577957:0:15347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f4629b4d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.577963:0:15347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8d73ee400 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309689.577969:0:15347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f4629b4d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.577992:0:15347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f4629b4d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.578007:0:15347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c8d832f800) 00010000:00010000:2.0:1788309689.578010:0:15347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788309689.578016:0:15347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f4629b4d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.578023:0:15347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ee400/0x63a04852f4629b4d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.578040:0:15347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4629b54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.578046:0:15347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4629b54 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.578052:0:15347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4629b54 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.578058:0:15347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d9c00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309689.578060:0:15347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4629b54 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.578067:0:15347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4629b54 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.578073:0:15347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff97c8d83f4600) 00010000:00010000:2.0:1788309689.578076:0:15347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788309689.578078:0:15347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4629b54 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.578094:0:15347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4629b54 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.579128:0:15347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f4629b46 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ae99 expref: 11 pid: 15347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.579148:0:15347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c8d832f800) 00010000:00010000:2.0:1788309689.579150:0:15347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788309689.579155:0:15347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef800/0x63a04852f4629b46 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146ae99 expref: 11 pid: 15347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.579176:0:15347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8d73ef800, rc 0) 00000100:00100000:2.0:1788309689.579307:0:15347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6586d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58cbd1af-e5b9-4e74-a0c2-c243cb2213cd+10:14420:x1875178192751232:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 2371us (2681us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1788309689.579318:0:15347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 25 00000100:00100000:1.0:1788309689.581667:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309689.582812:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192751360 00000100:00100000:2.0:1788309689.582829:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192751360 00000100:00100000:2.0:1788309689.582908:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 26 00000100:00100000:2.0:1788309689.582921:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c89f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58cbd1af-e5b9-4e74-a0c2-c243cb2213cd+10:14420:x1875178192751360:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:2.0:1788309689.582958:0:14364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309689.582993:0:14364:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9e00/0x63a04852f4629b62 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146aea0 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.583125:0:14364:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4629b69 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.583145:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4629b69 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.583213:0:14364:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4629b69 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788309689.583319:0:14364:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1788309689.583762:0:14364:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788309689.583806:0:14364:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4629b69 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.583847:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9e00/0x63a04852f4629b62 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aea0 expref: 12 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.583875:0:14364:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4629b69 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aea0 expref: 11 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.583886:0:14364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff97c8d83f4800) 00010000:00010000:2.0:1788309689.583889:0:14364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788309689.583894:0:14364:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8e26d8c00, rc 0) 00000100:00100000:2.0:1788309689.583988:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c89f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58cbd1af-e5b9-4e74-a0c2-c243cb2213cd+11:14420:x1875178192751360:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 1069us (2336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309689.583996:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 26 00000100:00100000:1.0:1788309689.592015:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309689.592361:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192751488 00000100:00100000:2.0:1788309689.592376:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192751488 00000100:00100000:2.0:1788309689.592487:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 3 00000100:00100000:2.0:1788309689.592700:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c89f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58cbd1af-e5b9-4e74-a0c2-c243cb2213cd+11:14420:x1875178192751488:12345-192.168.202.55@tcp:37:lfs.0 00000100:00100000:0.0:1788309689.601640:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c89f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58cbd1af-e5b9-4e74-a0c2-c243cb2213cd+11:14420:x1875178192751488:12345-192.168.202.55@tcp:37:lfs.0 Request processed in 9126us (9624us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309689.601661:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 3 00000100:00100000:1.0:1788309689.606477:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309689.606613:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192751744 00000100:00100000:3.0:1788309689.606625:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192751744 00000100:00100000:3.0:1788309689.606687:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 4 00000100:00100000:3.0:1788309689.606696:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ea298c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58cbd1af-e5b9-4e74-a0c2-c243cb2213cd+11:14420:x1875178192751744:12345-192.168.202.55@tcp:35:lfs.0 00000100:00100000:3.0:1788309689.607002:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ea298c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58cbd1af-e5b9-4e74-a0c2-c243cb2213cd+12:14420:x1875178192751744:12345-192.168.202.55@tcp:35:lfs.0 Request processed in 306us (544us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1788309689.607008:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 4 00000100:00100000:1.0:1788309689.657581:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309689.657808:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192751872 00000100:00100000:2.0:1788309689.657822:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192751872 00000100:00100000:2.0:1788309689.657906:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 27 00000100:00100000:2.0:1788309689.657918:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c89fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+10:14426:x1875178192751872:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:2.0:1788309689.657966:0:14363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309689.657992:0:14363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4629b70 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146aea7 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.658074:0:14363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4629b77 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.658091:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4629b77 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.658116:0:14363:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4629b77 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.658136:0:14363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4629b7e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.658144:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4629b7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.658151:0:14363:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4629b7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.658373:0:14363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9600/0x63a04852f4629b85 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.658383:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9600/0x63a04852f4629b85 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.658390:0:14363:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9600/0x63a04852f4629b85 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788309689.658430:0:14363:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1788309689.658441:0:14363:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788309689.658501:0:14363:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9600/0x63a04852f4629b85 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.658518:0:14363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4629b77 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.658525:0:14363:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4629b77 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.658533:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4629b77 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.658539:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d8800 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309689.658545:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4629b77 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.658553:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4629b77 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.658570:0:14363:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c8d832f800) 00010000:00010000:2.0:1788309689.658573:0:14363:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788309689.658580:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4629b77 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.658587:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4629b77 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.658607:0:14363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4629b7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.658614:0:14363:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4629b7e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.658632:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4629b7e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.658636:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d8600 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309689.658638:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4629b7e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.658642:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4629b7e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.658647:0:14363:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff97c8d83f4600) 00010000:00010000:2.0:1788309689.658648:0:14363:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788309689.658650:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4629b7e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.658654:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4629b7e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.658684:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4629b70 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aea7 expref: 12 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.658696:0:14363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9600/0x63a04852f4629b85 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aea7 expref: 11 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.658701:0:14363:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff97c8d83f4800) 00010000:00010000:2.0:1788309689.658702:0:14363:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788309689.658704:0:14363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8e26d9600, rc 0) 00000100:00100000:2.0:1788309689.659223:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c89fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+11:14426:x1875178192751872:12345-192.168.202.55@tcp:101:bash.0 Request processed in 1304us (1656us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309689.659243:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 27 00000100:00100000:2.0:1788309689.666254:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309689.666814:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192752128 00000100:00100000:1.0:1788309689.666830:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192752128 00000100:00100000:1.0:1788309689.666965:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 28 00000100:00100000:1.0:1788309689.666981:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6584000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+11:14426:x1875178192752128:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:1.0:1788309689.667011:0:14364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788309689.667044:0:14364:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549000/0x63a04852f4629b8c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146aeae expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309689.667381:0:14364:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548c00/0x63a04852f4629b93 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309689.667402:0:14364:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4629b69 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aea0 expref: 11 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309689.667437:0:14364:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548c00/0x63a04852f4629b93 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309689.667487:0:14364:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4629b69 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aea0 expref: 11 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309689.667505:0:14364:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4629b69 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aea0 expref: 11 pid: 14364 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309689.667525:0:14364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8c89fb800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14364:1875178210567040:192.168.202.55@tcp:104: 00000100:00100000:1.0:1788309689.667678:0:14364:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c60cf6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788309689.670868:0:14364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8c89fb800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14364:1875178210567040:192.168.202.55@tcp:104: 00010000:00010000:1.0:1788309689.670911:0:14364:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548c00/0x63a04852f4629b93 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309689.675567:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309689.676256:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192752256 00000100:00100000:0.0:1788309689.676271:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192752256 00010000:00010000:0.0:1788309689.676371:0:14349:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4629b69 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aea0 expref: 12 pid: 14364 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309689.676432:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 10 00000100:00100000:0.0:1788309689.676474:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6587b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58cbd1af-e5b9-4e74-a0c2-c243cb2213cd+12:2351:x1875178192752256:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788309689.676495:0:14349:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788309689.676504:0:14349:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4629b69 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aea0 expref: 12 pid: 14364 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309689.676534:0:14349:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4629b69 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aea0 expref: 12 pid: 14364 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309689.676565:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4629b69 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aea0 expref: 12 pid: 14364 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309689.676589:0:14349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff97c8d83f4800) 00010000:00010000:0.0:1788309689.676595:0:14349:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548c00/0x63a04852f4629b93 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309689.676607:0:14349:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548c00/0x63a04852f4629b93 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309689.676616:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548c00/0x63a04852f4629b93 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309689.676645:0:14349:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788309689.676722:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6587b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58cbd1af-e5b9-4e74-a0c2-c243cb2213cd+11:2351:x1875178192752256:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 252us (1171us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309689.676730:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 10 00010000:00010000:1.0:1788309689.677049:0:14364:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548c00/0x63a04852f4629b93 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309689.677059:0:14364:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548c00/0x63a04852f4629b93 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309689.677094:0:14364:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548400/0x63a04852f4629b9a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309689.677106:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548400/0x63a04852f4629b9a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309689.677115:0:14364:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548400/0x63a04852f4629b9a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309689.678936:0:14364:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4629ba1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309689.678959:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4629ba1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309689.678971:0:14364:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4629ba1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788309689.678987:0:14364:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788309689.679024:0:14364:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548c00/0x63a04852f4629b93 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309689.679032:0:14364:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548c00/0x63a04852f4629b93 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309689.679040:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548c00/0x63a04852f4629b93 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309689.679047:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8f5548c00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:1.0:1788309689.679052:0:14364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548c00/0x63a04852f4629b93 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309689.679061:0:14364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548c00/0x63a04852f4629b93 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309689.679076:0:14364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff97c8d83f4800) 00010000:00010000:1.0:1788309689.679080:0:14364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788309689.679084:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548c00/0x63a04852f4629b93 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309689.679122:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548c00/0x63a04852f4629b93 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788309689.679141:0:14364:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001f9d2cd3 reply state 000000003f51b947 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548400/0x63a04852f4629b9a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309689.679152:0:14364:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788309689.679221:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549000/0x63a04852f4629b8c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aeae expref: 14 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309689.679241:0:14364:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4629ba1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aeae expref: 13 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309689.679249:0:14364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97c8d832f400) 00010000:00010000:1.0:1788309689.679252:0:14364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1788309689.679254:0:14364:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8f5548000, rc 0) 00000100:00100000:1.0:1788309689.679397:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6584000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+14:14426:x1875178192752128:12345-192.168.202.55@tcp:101:bash.0 Request processed in 12419us (13158us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1788309689.679408:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 28 00010000:00010000:3.0:1788309689.682337:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548400/0x63a04852f4629b9a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309689.682363:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548400/0x63a04852f4629b9a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309689.682372:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548400/0x63a04852f4629b9a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309689.682378:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8f5548400 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:3.0:1788309689.682384:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548400/0x63a04852f4629b9a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309689.682416:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548400/0x63a04852f4629b9a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309689.682440:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff97c8d832f100) 00010000:00010000:3.0:1788309689.682443:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788309689.682449:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548400/0x63a04852f4629b9a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309689.682456:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548400/0x63a04852f4629b9a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309689.703047:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309689.703234:0:15347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192752384 00000100:00100000:3.0:1788309689.703248:0:15347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192752384 00000100:00100000:3.0:1788309689.703353:0:15347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 29 00000100:00100000:3.0:1788309689.703367:0:15347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6587800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+13:14426:x1875178192752384:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:3.0:1788309689.703401:0:15347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309689.703430:0:15347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef000/0x63a04852f4629baf lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146aeb5 expref: -99 pid: 15347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309689.703822:0:15347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f4629bb6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309689.703840:0:15347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f4629bb6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309689.703855:0:15347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f4629bb6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788309689.703908:0:15347:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788309689.703934:0:15347:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788309689.703966:0:15347:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f4629bb6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309689.703980:0:15347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f4629bb6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309689.704012:0:15347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef000/0x63a04852f4629baf lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aeb5 expref: 15 pid: 15347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309689.704037:0:15347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f4629bb6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aeb5 expref: 14 pid: 15347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309689.704048:0:15347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97c8d832f400) 00010000:00010000:3.0:1788309689.704051:0:15347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788309689.704056:0:15347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8d73ef200, rc 0) 00000100:00100000:3.0:1788309689.704255:0:15347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6587800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+14:14426:x1875178192752384:12345-192.168.202.55@tcp:101:bash.0 Request processed in 890us (1222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309689.704264:0:15347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 29 00000100:00100000:2.0:1788309689.710775:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309689.710912:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192752640 00000100:00100000:3.0:1788309689.710927:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192752640 00000100:00100000:3.0:1788309689.711057:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 5 00000100:00100000:3.0:1788309689.711071:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6586680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+14:14426:x1875178192752640:12345-192.168.202.55@tcp:35:bash.0 00000100:00100000:3.0:1788309689.712012:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6586680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+15:14426:x1875178192752640:12345-192.168.202.55@tcp:35:bash.0 Request processed in 939us (1248us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1788309689.712023:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 5 00000100:00100000:2.0:1788309689.863464:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309689.868043:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192752896 00000100:00100000:0.0:1788309689.868065:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192752896 00000100:00100000:0.0:1788309689.868185:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 30 00000100:00100000:0.0:1788309689.868198:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6584a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+15:14436:x1875178192752896:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:0.0:1788309689.868247:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788309689.868307:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e400/0x63a04852f4629bbd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146aebc expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788309689.868800:0:14362:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1788309689.869032:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e400/0x63a04852f4629bbd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aebc expref: 17 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309689.869051:0:14362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c8d832f800) 00010000:00010000:0.0:1788309689.869054:0:14362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788309689.869060:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e400/0x63a04852f4629bbd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aebc expref: 17 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309689.869075:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8ecf2e400, rc 0) 00000100:00100000:0.0:1788309689.869188:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6584a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+16:14436:x1875178192752896:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 991us (5737us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1788309689.869196:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 30 00000100:00100000:1.0:1788309689.882862:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309689.883312:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192753152 00000100:00100000:0.0:1788309689.883326:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192753152 00000100:00100000:0.0:1788309689.883394:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 6 00000100:00100000:0.0:1788309689.883406:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c89fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+16:14436:x1875178192753152:12345-192.168.202.55@tcp:35:lfs.0 00000100:00100000:0.0:1788309689.884064:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c89fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+17:14436:x1875178192753152:12345-192.168.202.55@tcp:35:lfs.0 Request processed in 656us (1214us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1788309689.884075:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 6 00000001:00080000:3.0:1788309689.907148:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934596 is committed 00000001:00080000:3.0:1788309689.907740:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934600 is committed 00000001:00080000:3.0:1788309689.907783:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:3.0:1788309689.907794:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934601 is committed 00000001:00080000:3.0:1788309689.907799:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:2.0:1788309689.929479:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309689.929685:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192753408 00000100:00100000:1.0:1788309689.929699:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192753408 00000100:00100000:1.0:1788309689.929831:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 31 00000100:00100000:1.0:1788309689.929844:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6585180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+13:14439:x1875178192753408:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:1.0:1788309689.929879:0:14363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788309689.929909:0:14363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549000/0x63a04852f4629bcb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146aec3 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309689.930073:0:14363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548c00/0x63a04852f4629bd2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309689.930092:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548c00/0x63a04852f4629bd2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309689.930107:0:14363:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548c00/0x63a04852f4629bd2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788309689.930122:0:14363:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788309689.930691:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5549000/0x63a04852f4629bcb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aec3 expref: 16 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.930719:0:14363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548c00/0x63a04852f4629bd2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aec3 expref: 15 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309689.930731:0:14363:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97c8d832f400) 00010000:00010000:2.0:1788309689.930734:0:14363:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788309689.930739:0:14363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8f5548c00, rc 0) 00000100:00100000:2.0:1788309689.930828:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6585180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+15:14439:x1875178192753408:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 986us (1364us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1788309689.930837:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 31 00000100:00100000:2.0:1788309689.934876:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309689.934919:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309689.935034:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192753536 00000100:00100000:0.0:1788309689.935047:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192753536 00000100:00100000:0.0:1788309689.935122:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 32 00000100:00100000:0.0:1788309689.935159:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6585500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+15:14439:x1875178192753536:12345-192.168.202.55@tcp:54:lfs.0 00010000:00010000:0.0:1788309689.935311:0:14362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e400/0x63a04852f4629be0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309689.935336:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e400/0x63a04852f4629be0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309689.935353:0:14362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e400/0x63a04852f4629be0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309689.935391:0:14362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e400/0x63a04852f4629be0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309689.935398:0:14362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e400/0x63a04852f4629be0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309689.935406:0:14362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e400/0x63a04852f4629be0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309689.935412:0:14362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8ecf2e400 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:0.0:1788309689.935418:0:14362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e400/0x63a04852f4629be0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309689.935426:0:14362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e400/0x63a04852f4629be0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309689.935442:0:14362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97c8d832f400) 00010000:00010000:0.0:1788309689.935445:0:14362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788309689.935451:0:14362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e400/0x63a04852f4629be0 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309689.935456:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e400/0x63a04852f4629be0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309689.935756:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6585500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+15:14439:x1875178192753536:12345-192.168.202.55@tcp:54:lfs.0 Request processed in 600us (894us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309689.935765:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 32 00000100:00100000:1.0:1788309689.935886:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192753664 00000100:00100000:1.0:1788309689.935893:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192753664 00000100:00100000:1.0:1788309689.935944:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 0 00000100:00100000:1.0:1788309689.935953:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6587480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+15:2352:x1875178192753664:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788309689.935967:0:14347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788309689.935987:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548c00/0x63a04852f4629bd2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aec3 expref: 15 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309689.936003:0:14347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97c8d832f400) 00010000:00010000:1.0:1788309689.936007:0:14347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788309689.936031:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6587480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+14:2352:x1875178192753664:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 80us (1112us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309689.936038:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 0 00000100:00100000:1.0:1788309689.939976:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309689.940073:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192753920 00000100:00100000:0.0:1788309689.940086:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192753920 00000100:00100000:0.0:1788309689.940197:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 7 00000100:00100000:0.0:1788309689.940212:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c89faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+14:14439:x1875178192753920:12345-192.168.202.55@tcp:35:lfs.0 00000100:00100000:0.0:1788309689.940848:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c89faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+15:14439:x1875178192753920:12345-192.168.202.55@tcp:35:lfs.0 Request processed in 637us (883us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1788309689.940857:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 7 00010000:00010000:3.0:1788309690.016814:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788309690.224131:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309690.224321:0:15347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192754176 00000100:00100000:3.0:1788309690.224336:0:15347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192754176 00000100:00100000:3.0:1788309690.224431:0:15347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 33 00000100:00100000:3.0:1788309690.224444:0:15347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc76b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+15:14470:x1875178192754176:12345-192.168.202.55@tcp:101:cat.0 00010000:00010000:3.0:1788309690.224485:0:15347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309690.224523:0:15347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef000/0x63a04852f4629be7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146aeca expref: -99 pid: 15347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309690.224673:0:15347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73efe00/0x63a04852f4629bee lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309690.224691:0:15347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73efe00/0x63a04852f4629bee lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309690.224705:0:15347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73efe00/0x63a04852f4629bee lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788309690.224721:0:15347:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788309690.224922:0:15347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef000/0x63a04852f4629be7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aeca expref: 18 pid: 15347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309690.224945:0:15347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73efe00/0x63a04852f4629bee lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aeca expref: 17 pid: 15347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309690.224956:0:15347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97c8d832f400) 00010000:00010000:3.0:1788309690.224959:0:15347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788309690.224982:0:15347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8d73efe00, rc 0) 00000100:00100000:3.0:1788309690.225078:0:15347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc76b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+17:14470:x1875178192754176:12345-192.168.202.55@tcp:101:cat.0 Request processed in 636us (966us total) trans 8589934606 rc 0/0 00000100:00100000:3.0:1788309690.225087:0:15347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 33 00000100:00080000:1.0:1788309690.225200:0:14358:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788309690.231006:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309690.231069:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309690.231207:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192754560 00000100:00100000:2.0:1788309690.231222:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192754560 00000100:00100000:2.0:1788309690.231340:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 1 00000100:00100000:2.0:1788309690.231356:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc91f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+17:2353:x1875178192754560:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788309690.231398:0:14348:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788309690.231437:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73efe00/0x63a04852f4629bee lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aeca expref: 17 pid: 15347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.231465:0:14348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97c8d832f400) 00010000:00010000:2.0:1788309690.231942:0:14348:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788309690.232038:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc91f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+16:2353:x1875178192754560:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 685us (967us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309690.232047:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 1 00000100:00100000:1.0:1788309690.233529:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192754432 00000100:00100000:1.0:1788309690.233545:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192754432 00000100:00100000:1.0:1788309690.233638:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 8 00000100:00100000:1.0:1788309690.233651:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc91ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+16:14470:x1875178192754432:12345-192.168.202.55@tcp:35:cat.0 00000100:00100000:1.0:1788309690.234919:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc91ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+17:14470:x1875178192754432:12345-192.168.202.55@tcp:35:cat.0 Request processed in 1262us (3918us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1788309690.234932:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 8 00000100:00100000:3.0:1788309690.327419:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309690.327921:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192754816 00000100:00100000:0.0:1788309690.327936:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192754816 00000100:00100000:0.0:1788309690.328021:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 34 00000100:00100000:0.0:1788309690.328035:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc91d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+17:14476:x1875178192754816:12345-192.168.202.55@tcp:101:dd.0 00010000:00010000:0.0:1788309690.328069:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788309690.328114:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e600/0x63a04852f4629bfc lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146aed1 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309690.328259:0:14362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ea00/0x63a04852f4629c03 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309690.328304:0:14362:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4629ba1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aeae expref: 18 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309690.328314:0:14362:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f4629bb6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aeb5 expref: 18 pid: 15347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309690.328349:0:14362:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ea00/0x63a04852f4629c03 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309690.328398:0:14362:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f4629bb6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aeb5 expref: 18 pid: 15347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309690.328415:0:14362:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f4629bb6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aeb5 expref: 18 pid: 15347 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309690.328433:0:14362:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffbb1500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14362:1875178210567168:192.168.202.55@tcp:104: 00010000:00010000:0.0:1788309690.328595:0:14362:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4629ba1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aeae expref: 18 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309690.328605:0:14362:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4629ba1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aeae expref: 18 pid: 14364 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309690.328615:0:14362:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ffbb0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14362:1875178210567296:192.168.202.55@tcp:104: 00000100:00100000:0.0:1788309690.328640:0:14362:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d6aee000 going to sleep for 11 seconds 00000100:00100000:0.0:1788309690.333659:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309690.333711:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309690.334029:0:14362:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffbb1500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14362:1875178210567168:192.168.202.55@tcp:104: 00000100:00100000:1.0:1788309690.334045:0:14362:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ffbb0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14362:1875178210567296:192.168.202.55@tcp:104: 00010000:00010000:1.0:1788309690.334174:0:14362:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ea00/0x63a04852f4629c03 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309690.335224:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192754944 00000100:00100000:3.0:1788309690.335237:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192754944 00010000:00010000:3.0:1788309690.335313:0:14349:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f4629bb6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aeb5 expref: 19 pid: 15347 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309690.335362:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192755072 00000100:00100000:3.0:1788309690.335367:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192755072 00010000:00010000:3.0:1788309690.335381:0:14349:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4629ba1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aeae expref: 20 pid: 14364 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309690.335400:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 11 00000100:00100000:3.0:1788309690.335412:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffd9d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+20:2353:x1875178192754944:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788309690.335431:0:14349:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788309690.335439:0:14349:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f4629bb6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aeb5 expref: 20 pid: 15347 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309690.335456:0:14349:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f4629bb6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aeb5 expref: 20 pid: 15347 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309690.335491:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f4629bb6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aeb5 expref: 20 pid: 15347 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309690.335821:0:14349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97c8d832f400) 00010000:00010000:3.0:1788309690.335827:0:14349:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ea00/0x63a04852f4629c03 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309690.335837:0:14349:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ea00/0x63a04852f4629c03 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309690.335845:0:14349:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788309690.335933:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffd9d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+19:2353:x1875178192754944:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 521us (2290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309690.335941:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 11 00000100:00100000:3.0:1788309690.336013:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 12 00000100:00100000:3.0:1788309690.336021:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffbb0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+18:2352:x1875178192755072:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788309690.336033:0:14349:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788309690.336039:0:14349:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4629ba1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aeae expref: 18 pid: 14364 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309690.336049:0:14349:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4629ba1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aeae expref: 18 pid: 14364 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309690.336064:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8f5548000/0x63a04852f4629ba1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aeae expref: 18 pid: 14364 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309690.336075:0:14349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97c8d832f400) 00010000:00010000:3.0:1788309690.336079:0:14349:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ea00/0x63a04852f4629c03 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309690.336100:0:14349:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ea00/0x63a04852f4629c03 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309690.336109:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ea00/0x63a04852f4629c03 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309690.336135:0:14349:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788309690.336157:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffbb0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+17:2352:x1875178192755072:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 137us (2449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309690.336175:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 12 00010000:00010000:1.0:1788309690.337352:0:14362:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ea00/0x63a04852f4629c03 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309690.337369:0:14362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ea00/0x63a04852f4629c03 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788309690.337397:0:14362:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788309690.337892:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e600/0x63a04852f4629bfc lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aed1 expref: 18 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309690.337918:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ea00/0x63a04852f4629c03 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aed1 expref: 17 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309690.337928:0:14362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97c8d832f400) 00010000:00010000:1.0:1788309690.337931:0:14362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788309690.337935:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8ecf2ea00, rc 0) 00000100:00100000:1.0:1788309690.338008:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc91d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+17:14476:x1875178192754816:12345-192.168.202.55@tcp:101:dd.0 Request processed in 9976us (10751us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1788309690.338030:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 34 00000100:00100000:3.0:1788309690.343868:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8c89fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210567424:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788309690.343973:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309690.344472:0:15048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210567424 00000100:00100000:1.0:1788309690.344484:0:15048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210567424 00000100:00100000:1.0:1788309690.344579:0:15048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788309690.344598:0:15048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc91f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875178210567424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788309690.344646:0:15048:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788309690.344713:0:15048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc91f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875178210567424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309690.344721:0:15048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788309690.344846:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8c89fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210567424:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788309690.345501:0:14358:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788309690.346927:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309690.347073:0:15347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192755328 00000100:00100000:3.0:1788309690.347087:0:15347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192755328 00000100:00100000:3.0:1788309690.347175:0:15347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 35 00000100:00100000:3.0:1788309690.347187:0:15347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffbb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+17:14476:x1875178192755328:12345-192.168.202.55@tcp:36:dd.0 00010000:00010000:0.0:1788309690.349646:0:15347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f4629c11 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309690.350212:0:15347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f4629c11 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309690.350256:0:15347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f4629c11 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788309690.350923:0:15347:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1788309690.351012:0:15347:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000034233627 reply state 00000000a64e492b transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f4629c11 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309690.351024:0:15347:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788309690.351914:0:15347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffbb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+20:14476:x1875178192755328:12345-192.168.202.55@tcp:36:dd.0 Request processed in 4720us (4989us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1788309690.351925:0:15347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 35 00000020:00080000:0.0:1788309690.351933:0:15347:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788309690.359612:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f4629c11 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309690.359638:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f4629c11 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309690.359648:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f4629c11 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309690.359656:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8ecf2ec00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:0.0:1788309690.359662:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f4629c11 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309690.359672:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f4629c11 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309690.359707:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97c8d832f400) 00010000:00010000:0.0:1788309690.359711:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788309690.359748:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f4629c11 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309690.359755:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ec00/0x63a04852f4629c11 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309690.360747:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309690.360826:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192755456 00000100:00100000:3.0:1788309690.360840:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192755456 00000100:00100000:3.0:1788309690.360918:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 36 00000100:00100000:3.0:1788309690.360931:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffbb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+19:14476:x1875178192755456:12345-192.168.202.55@tcp:101:dd.0 00010000:00010000:3.0:1788309690.360965:0:14364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309690.360993:0:14364:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f4629c18 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146aed8 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309690.361077:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f4629c18 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aed8 expref: 20 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309690.361467:0:14364:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f4629c18 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aed8 expref: 20 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309690.361497:0:14364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97c8d832f400) 00010000:00010000:3.0:1788309690.361500:0:14364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788309690.361504:0:14364:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8d73ef200, rc 0) 00000100:00100000:3.0:1788309690.361600:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffbb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+20:14476:x1875178192755456:12345-192.168.202.55@tcp:101:dd.0 Request processed in 671us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309690.361609:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 36 00000100:00100000:3.0:1788309690.407015:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309690.412397:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192755712 00000100:00100000:0.0:1788309690.412418:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192755712 00000100:00100000:0.0:1788309690.412616:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 2 00000100:00100000:0.0:1788309690.412630:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc91df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+20:14476:x1875178192755712:12345-192.168.202.55@tcp:103:dd.0 00010000:00010000:0.0:1788309690.412652:0:14349:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788309690.412701:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef200/0x63a04852f4629c18 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aed8 expref: 20 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309690.415366:0:14349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97c8d832f400) 00010000:00010000:0.0:1788309690.415385:0:14349:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788309690.415515:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc91df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+19:14476:x1875178192755712:12345-192.168.202.55@tcp:103:dd.0 Request processed in 2880us (8507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309690.415653:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 2 00000100:00100000:3.0:1788309690.421434:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309690.421559:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192755840 00000100:00100000:2.0:1788309690.421574:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192755840 00000100:00100000:2.0:1788309690.421657:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 37 00000100:00100000:2.0:1788309690.421669:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6586300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+19:14476:x1875178192755840:12345-192.168.202.55@tcp:58:dd.0 00010000:00010000:2.0:1788309690.421819:0:14363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9800/0x63a04852f4629c1f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.421841:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9800/0x63a04852f4629c1f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.421855:0:14363:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9800/0x63a04852f4629c1f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788309690.422810:0:14363:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788309690.422990:0:14363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1788309690.423083:0:14363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1788309690.423250:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6586300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+19:14476:x1875178192755840:12345-192.168.202.55@tcp:58:dd.0 Request processed in 1577us (1827us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309690.423263:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 37 00000100:00100000:3.0:1788309690.427238:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309690.429928:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192755968 00000100:00100000:2.0:1788309690.429949:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192755968 00000100:00100000:2.0:1788309690.430044:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 38 00000100:00100000:2.0:1788309690.430068:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6587b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+19:14476:x1875178192755968:12345-192.168.202.55@tcp:101:dd.0 00010000:00010000:2.0:1788309690.432481:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309690.432533:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4629c26 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146aedf expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.432631:0:14362:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9800/0x63a04852f4629c1f lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.432650:0:14362:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4629c26 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aedf expref: 20 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.432678:0:14362:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9800/0x63a04852f4629c1f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.432696:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4629c26 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aedf expref: 20 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.432712:0:14362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97c8d832f400) 00010000:00010000:2.0:1788309690.432715:0:14362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788309690.432720:0:14362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4629c26 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aedf expref: 20 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.432728:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8e26d8800, rc 0) 00000100:00100000:2.0:1788309690.432840:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6587b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+20:14476:x1875178192755968:12345-192.168.202.55@tcp:101:dd.0 Request processed in 2783us (5615us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309690.432851:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 38 00000040:00080000:1.0:1788309690.528996:0:14394:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788309690.529008:0:14394:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788309690.529048:0:14394:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788309690.529056:0:14394:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788309690.529249:0:14394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8c89fb100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14394:1875178210567552:192.168.202.55@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788309690.530681:0:14394:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c60cfc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788309690.532971:0:14394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8c89fb100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14394:1875178210567552:192.168.202.55@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788309690.544827:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309690.544973:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192756096 00000100:00100000:0.0:1788309690.544990:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192756096 00000100:00100000:0.0:1788309690.545079:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 0 00000100:00100000:0.0:1788309690.545095:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e6587480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+20:14477:x1875178192756096:12345-192.168.202.55@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1788309690.545257:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e6587480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+20:14477:x1875178192756096:12345-192.168.202.55@tcp:900:lhsmtool_posix.0 Request processed in 165us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309690.545266:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 0 00000100:00100000:3.0:1788309690.552600:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309690.553114:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192756224 00000100:00100000:2.0:1788309690.553128:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192756224 00000100:00100000:2.0:1788309690.553232:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 39 00000100:00100000:2.0:1788309690.553248:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e667f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+20:14477:x1875178192756224:12345-192.168.202.55@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788309690.553342:0:14363:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788309690.553511:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e667f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+20:14477:x1875178192756224:12345-192.168.202.55@tcp:53:lhsmtool_posix.0 Request processed in 267us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309690.553521:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 39 00000100:00100000:2.0:1788309690.560559:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309690.560677:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192756352 00000100:00100000:3.0:1788309690.560692:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192756352 00000100:00100000:3.0:1788309690.560770:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 40 00000100:00100000:3.0:1788309690.560785:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc76aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+20:14477:x1875178192756352:12345-192.168.202.55@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788309690.560912:0:14364:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef000/0x63a04852f4629c2d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309690.560935:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef000/0x63a04852f4629c2d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309690.560951:0:14364:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef000/0x63a04852f4629c2d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309690.562935:0:14364:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eea00/0x63a04852f4629c34 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309690.562962:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eea00/0x63a04852f4629c34 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309690.562977:0:14364:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eea00/0x63a04852f4629c34 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309690.563013:0:14364:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eec00/0x63a04852f4629c3b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309690.563023:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eec00/0x63a04852f4629c3b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309690.563030:0:14364:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eec00/0x63a04852f4629c3b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788309690.563235:0:14364:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788309690.563241:0:14364:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788309690.563258:0:14364:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eec00/0x63a04852f4629c3b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309690.563271:0:14364:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef000/0x63a04852f4629c2d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309690.563301:0:14364:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef000/0x63a04852f4629c2d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309690.563308:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef000/0x63a04852f4629c2d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309690.563338:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8d73ef000 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:3.0:1788309690.563343:0:14364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef000/0x63a04852f4629c2d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309690.563351:0:14364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef000/0x63a04852f4629c2d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309690.563366:0:14364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97c8d832fc00) 00010000:00010000:3.0:1788309690.563369:0:14364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788309690.563374:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef000/0x63a04852f4629c2d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309690.563380:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73ef000/0x63a04852f4629c2d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309690.565462:0:14364:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eea00/0x63a04852f4629c34 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309690.565473:0:14364:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eea00/0x63a04852f4629c34 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309690.565481:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eea00/0x63a04852f4629c34 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309690.565486:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8d73eea00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:3.0:1788309690.565491:0:14364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eea00/0x63a04852f4629c34 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309690.565499:0:14364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eea00/0x63a04852f4629c34 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309690.565535:0:14364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff97c902070300) 00010000:00010000:3.0:1788309690.565538:0:14364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788309690.565542:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eea00/0x63a04852f4629c34 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309690.565549:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eea00/0x63a04852f4629c34 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309690.565569:0:14364:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eec00/0x63a04852f4629c3b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309690.565575:0:14364:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eec00/0x63a04852f4629c3b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309690.565581:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eec00/0x63a04852f4629c3b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309690.565586:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8d73eec00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:3.0:1788309690.565589:0:14364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eec00/0x63a04852f4629c3b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309690.565595:0:14364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eec00/0x63a04852f4629c3b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309690.565602:0:14364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97c8d832f400) 00010000:00010000:3.0:1788309690.565604:0:14364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788309690.565607:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eec00/0x63a04852f4629c3b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309690.565612:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eec00/0x63a04852f4629c3b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309690.567374:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc76aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+20:14477:x1875178192756352:12345-192.168.202.55@tcp:34:lhsmtool_posix.0 Request processed in 6578us (6818us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309690.567388:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 40 00000100:00100000:0.0:1788309690.579993:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309690.580909:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192756608 00000100:00100000:2.0:1788309690.580930:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192756608 00000100:00100000:2.0:1788309690.581035:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 41 00000100:00100000:2.0:1788309690.581049:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ffbb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+20:14477:x1875178192756608:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788309690.581079:0:14363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309690.581112:0:14363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4629c42 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146aee6 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.581267:0:14363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9e00/0x63a04852f4629c49 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.581357:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9e00/0x63a04852f4629c49 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.581373:0:14363:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9e00/0x63a04852f4629c49 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788309690.581389:0:14363:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788309690.582330:0:14363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9e00/0x63a04852f4629c49 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.582374:0:14363:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9e00/0x63a04852f4629c49 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.582384:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9e00/0x63a04852f4629c49 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.582391:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d9e00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309690.582398:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9e00/0x63a04852f4629c49 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.582408:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9e00/0x63a04852f4629c49 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.582431:0:14363:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97c8d832f400) 00010000:00010000:2.0:1788309690.582434:0:14363:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788309690.582440:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9e00/0x63a04852f4629c49 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.582446:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9e00/0x63a04852f4629c49 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.582524:0:14363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4629c42 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aee6 expref: 22 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.582538:0:14363:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97c8d832fc00) 00010000:00010000:2.0:1788309690.582541:0:14363:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788309690.582545:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4629c42 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aee6 expref: 22 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.582557:0:14363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8e26d8c00, rc 0) 00000100:00100000:2.0:1788309690.582665:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ffbb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+21:14477:x1875178192756608:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 1619us (2684us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1788309690.582675:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 41 00000100:00100000:1.0:1788309690.600667:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309690.600795:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192756736 00000100:00100000:2.0:1788309690.600817:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192756736 00000100:00100000:2.0:1788309690.600896:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 42 00000100:00100000:2.0:1788309690.600910:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c89fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+21:14477:x1875178192756736:12345-192.168.202.55@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788309690.600960:0:14362:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788309690.601120:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c89fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+21:14477:x1875178192756736:12345-192.168.202.55@tcp:53:lhsmtool_posix.0 Request processed in 212us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309690.601129:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 42 00000100:00100000:0.0:1788309690.613016:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309690.613219:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192756992 00000100:00100000:2.0:1788309690.613229:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192756992 00000100:00100000:2.0:1788309690.613332:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 43 00000100:00100000:2.0:1788309690.613344:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecb42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+21:14477:x1875178192756992:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788309690.613367:0:14363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309690.613391:0:14363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4629c57 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146aeed expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788309690.614211:0:14363:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x7:0x0], count =27 00000004:00080000:2.0:1788309690.614219:0:14363:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x7:0x0]+27 in llog 00000004:00080000:2.0:1788309690.614261:0:14363:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:2.0:1788309690.614544:0:14363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9e00/0x63a04852f4629c5e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.614560:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9e00/0x63a04852f4629c5e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.614582:0:14363:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9e00/0x63a04852f4629c5e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.614641:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4629c57 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aeed expref: 24 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.614661:0:14363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9e00/0x63a04852f4629c5e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aeed expref: 23 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.614670:0:14363:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff97c8d83f4600) 00010000:00010000:2.0:1788309690.614672:0:14363:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788309690.614676:0:14363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8e26d9e00, rc 0) 00000100:00100000:2.0:1788309690.614733:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecb42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+23:14477:x1875178192756992:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 1390us (1725us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1788309690.614741:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 43 00000100:00100000:1.0:1788309690.621411:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309690.622990:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192757248 00000100:00100000:2.0:1788309690.623007:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192757248 00000100:00100000:2.0:1788309690.623096:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 44 00000100:00100000:2.0:1788309690.623109:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c89f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+23:14477:x1875178192757248:12345-192.168.202.55@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788309690.623192:0:14362:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788309690.623953:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9e00/0x63a04852f4629c5e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aeed expref: 23 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.623977:0:14362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff97c8d83f4600) 00010000:00010000:2.0:1788309690.623988:0:14362:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788309690.624012:0:14362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4629c6c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.624041:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4629c6c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.624121:0:14362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4629c6c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.624140:0:14362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4629c73 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x91f2e03e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.624148:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4629c73 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x91f2e03e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.624319:0:14362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4629c73 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x91f2e03e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.624613:0:14362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4629c6c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.624621:0:14362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4629c6c lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.624628:0:14362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4629c6c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.624634:0:14362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d9c00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309690.624639:0:14362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4629c6c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.624648:0:14362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4629c6c lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.624658:0:14362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff97c8d83f4800) 00010000:00010000:2.0:1788309690.624668:0:14362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788309690.624673:0:14362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4629c6c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.624680:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9c00/0x63a04852f4629c6c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.624692:0:14362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4629c73 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x91f2e03e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.624698:0:14362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4629c73 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x91f2e03e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.624703:0:14362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4629c73 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x91f2e03e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.624708:0:14362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d8600 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309690.624710:0:14362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4629c73 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x91f2e03e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.624717:0:14362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4629c73 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x91f2e03e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.624725:0:14362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x91f2e03e (ffff97c8d83f4100) 00010000:00010000:2.0:1788309690.624727:0:14362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788309690.624730:0:14362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4629c73 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x91f2e03e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.624736:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4629c73 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x91f2e03e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309690.627397:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c89f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+22:14477:x1875178192757248:12345-192.168.202.55@tcp:36:lhsmtool_posix.0 Request processed in 4273us (5985us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788309690.627430:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 44 00000100:00100000:1.0:1788309690.632966:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309690.633634:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192757376 00000100:00100000:2.0:1788309690.633652:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192757376 00000100:00100000:2.0:1788309690.633745:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 45 00000100:00100000:2.0:1788309690.633757:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c89fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+22:14477:x1875178192757376:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788309690.633779:0:14363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309690.633805:0:14363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4629c7a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146aef4 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.633855:0:14363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9000/0x63a04852f4629c81 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.633870:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9000/0x63a04852f4629c81 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.633882:0:14363:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9000/0x63a04852f4629c81 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.633997:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9a00/0x63a04852f4629c7a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aef4 expref: 24 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.634019:0:14363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9000/0x63a04852f4629c81 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aef4 expref: 23 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.634028:0:14363:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff97c8d83f4e00) 00010000:00010000:2.0:1788309690.634030:0:14363:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788309690.634034:0:14363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8e26d9000, rc 0) 00000100:00100000:2.0:1788309690.634363:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c89fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+23:14477:x1875178192757376:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 608us (1413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309690.634379:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 45 00000100:00100000:2.0:1788309690.645908:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309690.648870:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192757632 00000100:00100000:3.0:1788309690.648894:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192757632 00000100:00100000:3.0:1788309690.649067:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 46 00000100:00100000:3.0:1788309690.649083:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+23:14477:x1875178192757632:12345-192.168.202.55@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788309690.649313:0:14364:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eec00/0x63a04852f4629c88 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309690.649335:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eec00/0x63a04852f4629c88 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309690.649349:0:14364:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eec00/0x63a04852f4629c88 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788309690.650152:0:14364:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:3.0:1788309690.650189:0:14364:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 453400911427ns, next at 454400907614ns, rc = 0 00000004:00010000:3.0:1788309690.650763:0:14364:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009f4cc063 reply state 0000000070d0b95c transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eec00/0x63a04852f4629c88 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309690.650777:0:14364:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788309690.651018:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+25:14477:x1875178192757632:12345-192.168.202.55@tcp:36:lhsmtool_posix.0 Request processed in 1934us (5122us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1788309690.651029:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 46 00010000:00010000:3.0:1788309690.665865:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eec00/0x63a04852f4629c88 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309690.665919:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eec00/0x63a04852f4629c88 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309690.665928:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eec00/0x63a04852f4629c88 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309690.665934:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8d73eec00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:3.0:1788309690.665941:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eec00/0x63a04852f4629c88 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309690.665950:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eec00/0x63a04852f4629c88 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309690.665973:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff97c8d83f4e00) 00010000:00010000:3.0:1788309690.665977:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788309690.665983:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eec00/0x63a04852f4629c88 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309690.665990:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8d73eec00/0x63a04852f4629c88 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309690.677069:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309690.677603:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192757760 00000100:00100000:0.0:1788309690.677618:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192757760 00000100:00100000:0.0:1788309690.677699:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 47 00000100:00100000:0.0:1788309690.677713:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+24:14477:x1875178192757760:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788309690.677747:0:14363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788309690.677775:0:14363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f800/0x63a04852f4629c8f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146aefb expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309690.677856:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f800/0x63a04852f4629c8f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aefb expref: 25 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309690.677873:0:14363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f800/0x63a04852f4629c8f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aefb expref: 25 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309690.677899:0:14363:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff97c8d83f4e00) 00010000:00010000:0.0:1788309690.677902:0:14363:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788309690.677907:0:14363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8ecf2f800, rc 0) 00000100:00100000:0.0:1788309690.677990:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+25:14477:x1875178192757760:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 280us (935us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309690.677998:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 47 00000100:00100000:1.0:1788309690.694080:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309690.694252:0:15047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192757888 00000100:00100000:2.0:1788309690.694326:0:15047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192757888 00000100:00100000:2.0:1788309690.694466:0:15047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 12 00000100:00100000:2.0:1788309690.694482:0:15047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c89f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+5:2351:x1875178192757888:12345-192.168.202.55@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788309690.694987:0:15047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c89f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+6:2351:x1875178192757888:12345-192.168.202.55@tcp:2:lhsmtool_posix.0 Request processed in 508us (921us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788309690.694998:0:15047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 12 00000100:00080000:1.0:1788309690.695701:0:14358:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788309690.702867:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309690.702993:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192758144 00000100:00100000:0.0:1788309690.703007:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192758144 00000100:00100000:0.0:1788309690.703084:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 9 00000100:00100000:0.0:1788309690.703099:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c89f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+25:14477:x1875178192758144:12345-192.168.202.55@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788309690.703508:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c89f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+26:14477:x1875178192758144:12345-192.168.202.55@tcp:35:lhsmtool_posix.0 Request processed in 411us (658us total) trans 8589934614 rc 0/0 00000100:00100000:0.0:1788309690.703533:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 9 00000100:00100000:0.0:1788309690.708230:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309690.712748:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192758400 00000100:00100000:2.0:1788309690.712773:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192758400 00000100:00100000:2.0:1788309690.713642:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 48 00000100:00100000:2.0:1788309690.713658:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8eff0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+26:14477:x1875178192758400:12345-192.168.202.55@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788309690.714232:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8eff0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+26:14477:x1875178192758400:12345-192.168.202.55@tcp:57:lhsmtool_posix.0 Request processed in 576us (6025us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309690.714244:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 48 00000100:00100000:3.0:1788309690.719809:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309690.725910:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192758528 00000100:00100000:0.0:1788309690.725936:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192758528 00000100:00100000:0.0:1788309690.726103:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 49 00000100:00100000:0.0:1788309690.726123:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e667d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+26:14477:x1875178192758528:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788309690.726172:0:14363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788309690.726208:0:14363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ee00/0x63a04852f4629c96 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146af02 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309690.726434:0:14363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e200/0x63a04852f4629c9d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309690.726454:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e200/0x63a04852f4629c9d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309690.726472:0:14363:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e200/0x63a04852f4629c9d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788309690.726733:0:14363:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788309690.726758:0:14363:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e200/0x63a04852f4629c9d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309690.726793:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2ee00/0x63a04852f4629c96 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146af02 expref: 28 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309690.726812:0:14363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e200/0x63a04852f4629c9d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146af02 expref: 27 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309690.726836:0:14363:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff97c8d83f4e00) 00010000:00010000:0.0:1788309690.726839:0:14363:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788309690.726844:0:14363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8ecf2e200, rc 0) 00000100:00100000:0.0:1788309690.726947:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e667d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+27:14477:x1875178192758528:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 830us (7164us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309690.726955:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 49 00000100:00100000:1.0:1788309690.732900:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309690.733028:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192758656 00000100:00100000:2.0:1788309690.733044:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192758656 00000100:00100000:2.0:1788309690.733128:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 13 00000100:00100000:2.0:1788309690.733141:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c89f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+6:2350:x1875178192758656:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788309690.733178:0:15044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309690.733230:0:15044:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b87a48d4/0x63a04852f4629ca4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146af09 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788309690.733331:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9770ba, blocks: 0x1 00010000:00010000:2.0:1788309690.733357:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=453s v=(0 0) 00010000:00010000:2.0:1788309690.733363:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788309690.733374:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b87a48d4/0x63a04852f4629ca4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146af09 expref: 7 pid: 15044 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.733400:0:15044:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b87a48d4/0x63a04852f4629ca4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146af09 expref: 7 pid: 15044 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.733416:0:15044:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8e26d9a00, rc 0) 00000100:00100000:2.0:1788309690.733486:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c89f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+7:2350:x1875178192758656:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 348us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309690.733494:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 13 00000100:00100000:3.0:1788309690.754784:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309690.755252:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192758912 00000100:00100000:2.0:1788309690.755325:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192758912 00000100:00100000:2.0:1788309690.755410:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 50 00000100:00100000:2.0:1788309690.755424:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8e667ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+27:14477:x1875178192758912:12345-192.168.202.55@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788309690.755583:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8e667ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+27:14477:x1875178192758912:12345-192.168.202.55@tcp:57:lhsmtool_posix.0 Request processed in 161us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309690.755593:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 50 00000100:00100000:1.0:1788309690.760751:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309690.760888:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192759040 00000100:00100000:0.0:1788309690.760901:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192759040 00000100:00100000:0.0:1788309690.760977:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 51 00000100:00100000:0.0:1788309690.760989:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c89fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+27:14477:x1875178192759040:12345-192.168.202.55@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788309690.838784:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:3.0:1788309690.838854:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:3.0:1788309690.838979:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc577480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875178210567680:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788309690.839203:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309690.839510:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c89fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+14:14477:x1875178192759040:12345-192.168.202.55@tcp:44:lhsmtool_posix.0 Request processed in 78512us (78764us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309690.839526:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 51 00000100:00100000:1.0:1788309690.841858:0:16007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210567680 00000100:00100000:1.0:1788309690.841871:0:16007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210567680 00000100:00100000:0.0:1788309690.842458:0:16007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788309690.842476:0:16007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc575180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1875178210567680:12345-0@lo:2:osp-syn-1-0.0 00000100:00080000:1.0:1788309690.842624:0:14358:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:0.0:1788309690.842758:0:16007:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788309690.842764:0:16007:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1788309690.842766:0:16007:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788309690.842768:0:16007:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788309690 -> 1788309690 00002000:00010000:0.0:1788309690.842771:0:16007:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788309690.842882:0:16007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc575180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3302:x1875178210567680:12345-0@lo:2:osp-syn-1-0.0 Request processed in 410us (3678us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1788309690.842891:0:16007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:3.0:1788309690.842958:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97c8fc577480/2, rc 0, transno 8589934595 00000100:00100000:3.0:1788309690.842969:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc577480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875178210567680:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788309690.846433:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309690.846546:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192759168 00000100:00100000:2.0:1788309690.846564:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192759168 00000100:00100000:2.0:1788309690.846715:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 15 00000100:00100000:2.0:1788309690.846730:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c89fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+7:2350:x1875178192759168:12345-192.168.202.55@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788309690.846908:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c89fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+7:2350:x1875178192759168:12345-192.168.202.55@tcp:16:lhsmtool_posix.0 Request processed in 180us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309690.846918:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 15 00000100:00100000:3.0:1788309690.850813:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309690.851078:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192759424 00000100:00100000:2.0:1788309690.851091:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192759424 00000100:00100000:2.0:1788309690.851187:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 52 00000100:00100000:2.0:1788309690.851204:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc577100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+14:14477:x1875178192759424:12345-192.168.202.55@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788309690.851434:0:14362:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788309690.851471:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2e200/0x63a04852f4629c9d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146af02 expref: 14 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.851496:0:14362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff97c8d83f4e00) 00010000:00010000:2.0:1788309690.851502:0:14362:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788309690.851542:0:14362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4629cab lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.851558:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4629cab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.851569:0:14362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4629cab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788309690.851841:0:14362:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001af6e20a reply state 0000000054e7cd08 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4629cab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309690.851852:0:14362:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788309690.851988:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc577100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+15:14477:x1875178192759424:12345-192.168.202.55@tcp:36:lhsmtool_posix.0 Request processed in 787us (1192us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1788309690.852018:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 52 00000100:00100000:1.0:1788309690.856114:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309690.856223:0:16007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192759552 00010000:00010000:0.0:1788309690.856227:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4629cab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309690.856242:0:16007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192759552 00010000:00010000:0.0:1788309690.856257:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4629cab lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309690.856264:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4629cab lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309690.856269:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d8600 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:0.0:1788309690.856273:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4629cab lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309690.856383:0:16007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 16 00000100:00100000:3.0:1788309690.856398:0:16007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c89f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+7:14477:x1875178192759552:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788309690.856422:0:16007:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309690.856446:0:16007:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003bd6d1a2/0x63a04852f4629cb2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8a28c761146af10 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309690.856487:0:16007:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b87a48d4/0x63a04852f4629ca4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146af09 expref: 8 pid: 15044 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309690.856498:0:16007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788309690.856503:0:16007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788309690.856509:0:16007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003bd6d1a2/0x63a04852f4629cb2 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146af10 expref: 8 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309690.856553:0:16007:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b87a48d4/0x63a04852f4629ca4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146af09 expref: 8 pid: 15044 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309690.856575:0:16007:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b87a48d4/0x63a04852f4629ca4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146af09 expref: 8 pid: 15044 timeout: 553 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309690.856594:0:16007:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc574a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:16007:1875178210567808:192.168.202.55@tcp:104: 00000100:00100000:3.0:1788309690.856713:0:16007:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8eff35e40 going to sleep for 11 seconds 00010000:00010000:0.0:1788309690.856821:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4629cab lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309690.856842:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff97c8d83f4e00) 00010000:00010000:0.0:1788309690.856845:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788309690.856849:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4629cab lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309690.856853:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8600/0x63a04852f4629cab lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309690.861214:0:16007:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc574a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:16007:1875178210567808:192.168.202.55@tcp:104: 00000100:00100000:1.0:1788309690.861214:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00010000:00010000:3.0:1788309690.861337:0:16007:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003bd6d1a2/0x63a04852f4629cb2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146af10 expref: 8 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309690.861357:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192759680 00010000:00010000:3.0:1788309690.861368:0:16007:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c8d73eec00, rc 0) 00000100:00100000:2.0:1788309690.861368:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192759680 00010000:00010000:2.0:1788309690.861421:0:14348:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b87a48d4/0x63a04852f4629ca4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146af09 expref: 9 pid: 15044 timeout: 553 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309690.861451:0:16007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c89f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+9:14477:x1875178192759552:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 5055us (5342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309690.861460:0:16007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 16 00000100:00100000:2.0:1788309690.861479:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 13 00000100:00100000:2.0:1788309690.861491:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c89f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+8:2351:x1875178192759680:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788309690.861516:0:14348:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788309690.861548:0:14348:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b87a48d4/0x63a04852f4629ca4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146af09 expref: 8 pid: 15044 timeout: 553 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.861563:0:14348:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b87a48d4/0x63a04852f4629ca4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146af09 expref: 8 pid: 15044 timeout: 553 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.861597:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b87a48d4/0x63a04852f4629ca4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146af09 expref: 8 pid: 15044 timeout: 553 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.861614:0:14348:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788309690.861619:0:14348:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788309690.861628:0:14348:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003bd6d1a2/0x63a04852f4629cb2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146af10 expref: 7 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.861640:0:14348:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003bd6d1a2/0x63a04852f4629cb2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146af10 expref: 7 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.861709:0:14348:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003bd6d1a2/0x63a04852f4629cb2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146af10 expref: 7 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309690.861728:0:14348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc769c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:14348:1875178210567936:192.168.202.55@tcp:105: 00000100:00100000:2.0:1788309690.861806:0:14348:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c94ad600 going to sleep for 11 seconds 00000100:00100000:2.0:1788309690.864784:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309690.864830:0:14348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc769c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:14348:1875178210567936:192.168.202.55@tcp:105: 00010000:00010000:0.0:1788309690.864858:0:14348:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788309690.864921:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c89f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+7:2351:x1875178192759680:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 3432us (3723us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309690.864930:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 13 00000100:00100000:3.0:1788309690.865008:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192759808 00000100:00100000:3.0:1788309690.865020:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192759808 00000100:00100000:3.0:1788309690.865181:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 17 00000100:00100000:3.0:1788309690.865196:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc769f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+7:2351:x1875178192759808:12345-192.168.202.55@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788309690.865678:0:15046:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788309690.865683:0:15046:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788309690 00002000:00010000:3.0:1788309690.865687:0:15046:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788309689 00002000:00010000:3.0:1788309690.865689:0:15046:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788309690 -> 1788309690 00002000:00010000:3.0:1788309690.865691:0:15046:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788309690.865797:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc769f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+8:2351:x1875178192759808:12345-192.168.202.55@tcp:2:lhsmtool_posix.0 Request processed in 604us (1024us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1788309690.865806:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 17 00000100:00100000:2.0:1788309690.869949:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309690.870043:0:15047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192759936 00000100:00100000:3.0:1788309690.870058:0:15047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192759936 00000100:00100000:3.0:1788309690.870135:0:15047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 18 00000100:00100000:3.0:1788309690.870148:0:15047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc76b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+8:2350:x1875178192759936:12345-192.168.202.55@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788309690.870234:0:15047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003cb2256d/0x63a04852f4629cb9 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309690.870326:0:15047:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003bd6d1a2/0x63a04852f4629cb2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146af10 expref: 8 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309690.870337:0:15047:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788309690.870343:0:15047:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788309690.870351:0:15047:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003cb2256d/0x63a04852f4629cb9 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309690.870403:0:15047:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003bd6d1a2/0x63a04852f4629cb2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146af10 expref: 8 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309690.870421:0:15047:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003bd6d1a2/0x63a04852f4629cb2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146af10 expref: 8 pid: 16007 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309690.870439:0:15047:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc574a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15047:1875178210568064:192.168.202.55@tcp:104: 00000100:00100000:3.0:1788309690.870551:0:15047:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8eff35e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788309690.875027:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309690.875204:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192760064 00000100:00100000:0.0:1788309690.875218:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192760064 00010000:00010000:0.0:1788309690.875487:0:14349:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003bd6d1a2/0x63a04852f4629cb2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146af10 expref: 9 pid: 16007 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309690.875570:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 14 00000100:00100000:0.0:1788309690.875584:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c89f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+9:2350:x1875178192760064:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788309690.875605:0:14349:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788309690.875635:0:14349:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003bd6d1a2/0x63a04852f4629cb2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146af10 expref: 9 pid: 16007 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309690.875651:0:14349:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003bd6d1a2/0x63a04852f4629cb2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146af10 expref: 9 pid: 16007 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309690.875685:0:14349:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788309690.875690:0:14349:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788309690.875698:0:14349:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003cb2256d/0x63a04852f4629cb9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309690.875709:0:14349:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003cb2256d/0x63a04852f4629cb9 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309690.875736:0:14349:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788309690.875870:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c89f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+9:2350:x1875178192760064:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 289us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309690.875879:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 14 00010000:00010000:3.0:1788309690.877616:0:15047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003bd6d1a2/0x63a04852f4629cb2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146af10 expref: 8 pid: 16007 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309690.877649:0:15047:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc574a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15047:1875178210568064:192.168.202.55@tcp:104: 00010000:00010000:3.0:1788309690.877683:0:15047:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003cb2256d/0x63a04852f4629cb9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.878111:0:15047:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003cb2256d/0x63a04852f4629cb9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.878123:0:15047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003cb2256d/0x63a04852f4629cb9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.878173:0:15047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003cb2256d/0x63a04852f4629cb9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.878184:0:15047:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003cb2256d/0x63a04852f4629cb9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.878463:0:15047:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003cb2256d/0x63a04852f4629cb9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.878473:0:15047:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8d73eea00 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:2.0:1788309690.878478:0:15047:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003cb2256d/0x63a04852f4629cb9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.878507:0:15047:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003cb2256d/0x63a04852f4629cb9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.878529:0:15047:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003cb2256d/0x63a04852f4629cb9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.878537:0:15047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003cb2256d/0x63a04852f4629cb9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309690.878646:0:15047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc76b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+7:2350:x1875178192759936:12345-192.168.202.55@tcp:1:lhsmtool_posix.0 Request processed in 8498us (8710us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309690.878657:0:15047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 18 00000100:00100000:1.0:1788309690.881256:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309690.881323:0:15347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192760320 00000100:00100000:2.0:1788309690.881336:0:15347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192760320 00000100:00100000:2.0:1788309690.881546:0:15347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 53 00000100:00100000:2.0:1788309690.881560:0:15347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c89f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+14:14477:x1875178192760320:12345-192.168.202.55@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788309690.881677:0:15347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9e00/0x63a04852f4629cc0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.881699:0:15347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9e00/0x63a04852f4629cc0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.881713:0:15347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9e00/0x63a04852f4629cc0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.882209:0:15347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4629cc7 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.882235:0:15347:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f800/0x63a04852f4629c8f lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aefb expref: 15 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.882243:0:15347:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4629cc7 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.882447:0:15347:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f800/0x63a04852f4629c8f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aefb expref: 15 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.882464:0:15347:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f800/0x63a04852f4629c8f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aefb expref: 15 pid: 14363 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309690.882482:0:15347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc768380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15347:1875178210568192:192.168.202.55@tcp:104: 00000100:00100000:2.0:1788309690.882594:0:15347:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c94ad600 going to sleep for 11 seconds 00000100:00100000:1.0:1788309690.886068:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309690.886260:0:15347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc768380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15347:1875178210568192:192.168.202.55@tcp:104: 00010000:00010000:2.0:1788309690.886340:0:15347:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4629cc7 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309690.886828:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192760448 00000100:00100000:0.0:1788309690.886838:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192760448 00010000:00010000:0.0:1788309690.886893:0:14348:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f800/0x63a04852f4629c8f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aefb expref: 16 pid: 14363 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309690.886965:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 15 00000100:00100000:0.0:1788309690.886977:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c89fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+16:2351:x1875178192760448:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788309690.887008:0:14348:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788309690.887016:0:14348:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f800/0x63a04852f4629c8f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aefb expref: 16 pid: 14363 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309690.887030:0:14348:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f800/0x63a04852f4629c8f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aefb expref: 16 pid: 14363 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309690.887059:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f800/0x63a04852f4629c8f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aefb expref: 16 pid: 14363 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309690.887081:0:14348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff97c8d83f4e00) 00010000:00010000:0.0:1788309690.887087:0:14348:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4629cc7 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309690.887098:0:14348:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4629cc7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309690.887107:0:14348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4629cc7 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309690.887138:0:14348:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788309690.887183:0:15347:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4629cc7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.887191:0:15347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4629cc7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309690.887219:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c89fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+15:2351:x1875178192760448:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 244us (1164us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309690.887227:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 15 00000001:00080000:2.0:1788309690.887472:0:15347:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1788309690.888779:0:15347:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1788309690.889227:0:15347:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1788309690.889466:0:15347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc768380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15347:1875178210568320:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788309690.893769:0:15347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309690.893820:0:15347:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8c5ee9b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788309690.893920:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210568320 00000100:00100000:1.0:1788309690.893939:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210568320 00000100:00100000:1.0:1788309690.894184:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788309690.894200:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc76a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:15347:x1875178210568320:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788309690.894398:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc76a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:15347:x1875178210568320:12345-0@lo:1000:mdt00_003.0 Request processed in 202us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309690.894406:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788309690.894653:0:15347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc768380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15347:1875178210568320:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1788309690.906174:0:15347:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1788309690.906323:0:15347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc768380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15347:1875178210568448:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788309690.906453:0:15347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309690.906505:0:15347:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d1493780 going to sleep for 11 seconds 00000100:00100000:3.0:1788309690.908395:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210568448 00000100:00100000:3.0:1788309690.908434:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210568448 00000100:00100000:3.0:1788309690.908529:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788309690.908542:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:15347:x1875178210568448:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788309690.908934:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:15347:x1875178210568448:12345-0@lo:1000:mdt00_003.0 Request processed in 393us (2479us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1788309690.908943:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788309690.909447:0:15347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc768380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15347:1875178210568448:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1788309690.909633:0:15347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4629cc7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.909646:0:15347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4629cc7 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.909655:0:15347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4629cc7 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.909662:0:15347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d8c00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309690.909668:0:15347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4629cc7 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.909676:0:15347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4629cc7 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.909695:0:15347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff97c8d83f4e00) 00010000:00010000:2.0:1788309690.909698:0:15347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788309690.909702:0:15347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4629cc7 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.909708:0:15347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8c00/0x63a04852f4629cc7 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.909766:0:15347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9800/0x63a04852f4629c1f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.909773:0:15347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9800/0x63a04852f4629c1f lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.909779:0:15347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9800/0x63a04852f4629c1f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.909784:0:15347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d9800 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309690.909788:0:15347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9800/0x63a04852f4629c1f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.909794:0:15347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9800/0x63a04852f4629c1f lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.909803:0:15347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97c8d832f400) 00010000:00010000:2.0:1788309690.909806:0:15347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788309690.909813:0:15347:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4629c26 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aedf expref: 18 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.909825:0:15347:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4629c26 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aedf expref: 18 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.909835:0:15347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4629c26 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aedf expref: 18 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.909902:0:15347:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d8800/0x63a04852f4629c26 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0xa8a28c761146aedf expref: 18 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309690.909932:0:15347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8fc769180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15347:1875178210568576:192.168.202.55@tcp:105: 00000100:00100000:2.0:1788309690.910032:0:15347:0:(client.c:2715:ptlrpc_set_wait()) set ffff97c8d1493a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788309690.913472:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309690.913594:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192760576 00000100:00100000:0.0:1788309690.913623:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192760576 00000100:00100000:2.0:1788309690.913662:0:15347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8fc769180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15347:1875178210568576:192.168.202.55@tcp:105: 00000100:00100000:0.0:1788309690.913698:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 10 00010000:00010000:2.0:1788309690.913706:0:15347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9800/0x63a04852f4629c1f lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309690.913715:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ea299450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+19:14476:x1875178192760576:12345-192.168.202.55@tcp:49:dd.0 00010000:00010000:2.0:1788309690.913726:0:15347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9800/0x63a04852f4629c1f lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.913771:0:15347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9200/0x63a04852f4629cce lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.913789:0:15347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9200/0x63a04852f4629cce lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.913806:0:15347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9200/0x63a04852f4629cce lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.913836:0:15347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9200/0x63a04852f4629cce lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.913844:0:15347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9200/0x63a04852f4629cce lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.913851:0:15347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9200/0x63a04852f4629cce lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.913857:0:15347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d9200 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309690.913860:0:15347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9200/0x63a04852f4629cce lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309690.913872:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ea299450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+19:14476:x1875178192760576:12345-192.168.202.55@tcp:49:dd.0 Request processed in 162us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309690.913900:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 10 00010000:00010000:2.0:1788309690.913901:0:15347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9200/0x63a04852f4629cce lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.913923:0:15347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97c8d832f400) 00010000:00010000:2.0:1788309690.913927:0:15347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788309690.913932:0:15347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9200/0x63a04852f4629cce lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.913938:0:15347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9200/0x63a04852f4629cce lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.913952:0:15347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9e00/0x63a04852f4629cc0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.913956:0:15347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9e00/0x63a04852f4629cc0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.913961:0:15347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9e00/0x63a04852f4629cc0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.913965:0:15347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d9e00 already unused, calling callback (ffffffffc22094f0) 00010000:00010000:2.0:1788309690.913967:0:15347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9e00/0x63a04852f4629cc0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.913971:0:15347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9e00/0x63a04852f4629cc0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.913978:0:15347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97c8d832f400) 00010000:00010000:2.0:1788309690.913980:0:15347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788309690.913982:0:15347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9e00/0x63a04852f4629cc0 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.914000:0:15347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8e26d9e00/0x63a04852f4629cc0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309690.914253:0:15347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c89f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+18:14477:x1875178192760320:12345-192.168.202.55@tcp:57:lhsmtool_posix.0 Request processed in 32695us (33006us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1788309690.914266:0:15347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 53 00000020:00080000:2.0:1788309690.914273:0:15347:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788309690.914649:0:14394:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788309690.914666:0:14394:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788309690.914713:0:14394:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788309690.914719:0:14394:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788309690.927781:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309690.928569:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192760832 00000100:00100000:0.0:1788309690.928586:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192760832 00000100:00100000:0.0:1788309690.928669:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 11 00000100:00100000:0.0:1788309690.928681:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc574a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+18:14477:x1875178192760832:12345-192.168.202.55@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788309690.929456:0:14365:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788309690.929568:0:14365:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:0.0:1788309690.929612:0:14365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f800/0x63a04852f4629cd5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309690.929630:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f800/0x63a04852f4629cd5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309690.929642:0:14365:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f800/0x63a04852f4629cd5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309690.929652:0:14365:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f800/0x63a04852f4629cd5 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309690.929659:0:14365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f800/0x63a04852f4629cd5 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309690.929665:0:14365:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f800/0x63a04852f4629cd5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309690.929701:0:14365:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788309690.929752:0:14351:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788309690.929767:0:14351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f800/0x63a04852f4629cd5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.929779:0:14351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8ecf2f800 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:2.0:1788309690.929785:0:14351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f800/0x63a04852f4629cd5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.929796:0:14351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f800/0x63a04852f4629cd5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309690.929823:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc574a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+20:14477:x1875178192760832:12345-192.168.202.55@tcp:35:lhsmtool_posix.0 Request processed in 1140us (2054us total) trans 8589934622 rc 0/0 00010000:00010000:2.0:1788309690.929827:0:14351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff97c8d83f4e00) 00010000:00010000:2.0:1788309690.929833:0:14351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00000100:00100000:0.0:1788309690.929835:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 11 00010000:00010000:2.0:1788309690.929841:0:14351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f800/0x63a04852f4629cd5 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788309690.929843:0:14365:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788309690.929854:0:14351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c8ecf2f800/0x63a04852f4629cd5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309690.929878:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309690.929881:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309690.929884:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309691.044227:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788309691.235915:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309691.236094:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309691.236130:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309691.236516:0:15050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192760960 00000100:00100000:1.0:1788309691.236526:0:15050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192760960 00000100:00100000:1.0:1788309691.236583:0:15050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192761088 00000100:00100000:1.0:1788309691.236587:0:15050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192761088 00000100:00100000:1.0:1788309691.236605:0:15050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192761216 00000100:00100000:1.0:1788309691.236607:0:15050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192761216 00000100:00100000:1.0:1788309691.236626:0:15050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 0 00000100:00100000:1.0:1788309691.236637:0:15050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecdc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+9:2352:x1875178192760960:12345-192.168.202.55@tcp:4:dd.0 00002000:00010000:1.0:1788309691.236691:0:15050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a9770ba, atime: 0x6a9770b9, ctime: 0x6a9770ba, blocks: 0x1 00010000:00010000:1.0:1788309691.236701:0:15050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047676437/0x63a04852f4629cdc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309691.236732:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=453s v=(0 0) 00010000:00010000:1.0:1788309691.236737:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788309691.236745:0:15050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000047676437/0x63a04852f4629cdc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309691.236776:0:15050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000047676437/0x63a04852f4629cdc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309691.250751:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309691.251004:0:15051:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1788309691.251022:0:15051:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1788309691.251412:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192761344 00000100:00100000:3.0:1788309691.251425:0:15051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192761344 00000100:00100000:2.0:1788309691.251993:0:16593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 1 00000100:00100000:2.0:1788309691.252006:0:16593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecdc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+11:2352:x1875178192761088:12345-192.168.202.55@tcp:4:dd.0 00010000:00010000:2.0:1788309691.252041:0:16593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4c502c1/0x63a04852f4629ce3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309691.252059:0:16593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788309691.252064:0:16593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788309691.252071:0:16593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4c502c1/0x63a04852f4629ce3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309691.252088:0:16593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4c502c1/0x63a04852f4629ce3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309691.258457:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788309691.258977:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788309691.261421:0:15051:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1788309691.262840:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788309691.262898:0:15052:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1788309691.266658:0:15051:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:3.0:1788309691.272313:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192761472 00000100:00100000:3.0:1788309691.272325:0:15051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192761472 00000100:00100000:3.0:1788309691.272392:0:15051:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1788309691.272400:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192761600 00000100:00100000:3.0:1788309691.272402:0:15051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192761600 00000100:00100000:3.0:1788309691.272797:0:16594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 2 00000100:00100000:3.0:1788309691.272806:0:16594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecdc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+14:2352:x1875178192761216:12345-192.168.202.55@tcp:4:dd.0 00010000:00010000:3.0:1788309691.272836:0:16594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001183343d/0x63a04852f4629cea lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309691.272851:0:16594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788309691.272855:0:16594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788309691.272860:0:16594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001183343d/0x63a04852f4629cea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309691.272878:0:16594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001183343d/0x63a04852f4629cea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309691.278553:0:15051:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:1.0:1788309691.278574:0:15051:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_005' 00000100:00100000:1.0:1788309691.278853:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309691.278886:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192761728 00000100:00100000:1.0:1788309691.278897:0:15051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192761728 00000100:00100000:1.0:1788309691.278959:0:15051:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:1.0:1788309691.278966:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192761856 00000100:00100000:1.0:1788309691.278969:0:15051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192761856 00000100:00100000:1.0:1788309691.279419:0:16595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 3 00000100:00100000:1.0:1788309691.279432:0:16595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecdc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+17:2352:x1875178192761344:12345-192.168.202.55@tcp:4:dd.0 00010000:00010000:1.0:1788309691.279478:0:16595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074d7d98e/0x63a04852f4629cf1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309691.279501:0:16595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788309691.279506:0:16595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788309691.279513:0:16595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074d7d98e/0x63a04852f4629cf1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309691.279543:0:16595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074d7d98e/0x63a04852f4629cf1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309691.279948:0:15052:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_006' 00000100:00100000:0.0:1788309691.291062:0:16596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 4 00000100:00100000:0.0:1788309691.291081:0:16596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecdc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+24:2353:x1875178192761472:12345-192.168.202.55@tcp:4:dd.0 00010000:00010000:0.0:1788309691.291125:0:16596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e3f1a1b/0x63a04852f4629cf8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309691.291143:0:16596:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788309691.291147:0:16596:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788309691.291168:0:16596:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e3f1a1b/0x63a04852f4629cf8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309691.291183:0:16596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e3f1a1b/0x63a04852f4629cf8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788309691.323226:0:7639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:2.0:1788309691.323249:0:7639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934595 is committed 00000001:00080000:2.0:1788309691.323258:0:7639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00000001:00080000:2.0:1788309691.323303:0:7639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00002000:00010000:0.0:1788309691.323304:0:15050:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 5242880 00002000:00010000:0.0:1788309691.323308:0:15050:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1788309690 -> 1788309691 00002000:00010000:0.0:1788309691.323311:0:15050:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788309690 -> 1788309691 00002000:00010000:0.0:1788309691.323314:0:15050:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 6151 00010000:00010000:0.0:1788309691.323330:0:15050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047676437/0x63a04852f4629cdc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309691.323363:0:15050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000047676437/0x63a04852f4629cdc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309691.323371:0:15050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000047676437/0x63a04852f4629cdc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309691.323379:0:15050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8f5548800 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:0.0:1788309691.323384:0:15050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000047676437/0x63a04852f4629cdc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309691.323394:0:15050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000047676437/0x63a04852f4629cdc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309691.323422:0:15050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000047676437/0x63a04852f4629cdc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309691.323430:0:15050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000047676437/0x63a04852f4629cdc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309691.323521:0:15050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecdc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+20:2352:x1875178192760960:12345-192.168.202.55@tcp:4:dd.0 Request processed in 86882us (87613us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1788309691.323531:0:15050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 0 00010000:00010000:0.0:1788309691.323722:0:16594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001183343d/0x63a04852f4629cea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309691.323732:0:16594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001183343d/0x63a04852f4629cea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309691.323745:0:16594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001183343d/0x63a04852f4629cea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309691.323752:0:16594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8d73ee200 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:0.0:1788309691.323756:0:16594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001183343d/0x63a04852f4629cea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309691.323764:0:16594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001183343d/0x63a04852f4629cea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309691.323775:0:16594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001183343d/0x63a04852f4629cea lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309691.323782:0:16593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4c502c1/0x63a04852f4629ce3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309691.323782:0:16594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001183343d/0x63a04852f4629cea lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309691.323791:0:16593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c4c502c1/0x63a04852f4629ce3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309691.323798:0:16593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c4c502c1/0x63a04852f4629ce3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309691.323804:0:16593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8e26d9e00 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:3.0:1788309691.323807:0:16593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4c502c1/0x63a04852f4629ce3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309691.323813:0:16594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecdc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+18:2352:x1875178192761216:12345-192.168.202.55@tcp:4:dd.0 Request processed in 51008us (87682us total) trans 8589934598 rc 0/0 00010000:00010000:3.0:1788309691.323815:0:16593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4c502c1/0x63a04852f4629ce3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309691.323820:0:16594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 2 00010000:00010000:3.0:1788309691.323826:0:16593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c4c502c1/0x63a04852f4629ce3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309691.323833:0:16593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4c502c1/0x63a04852f4629ce3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309691.323841:0:16594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 5 00000100:00100000:0.0:1788309691.323853:0:16594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecdc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+16:2353:x1875178192761600:12345-192.168.202.55@tcp:4:dd.0 00000100:00100000:3.0:1788309691.323863:0:16593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecdc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+16:2352:x1875178192761088:12345-192.168.202.55@tcp:4:dd.0 Request processed in 71861us (87770us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1788309691.323874:0:16593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 1 00010000:00010000:0.0:1788309691.323885:0:16594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd837b78/0x63a04852f4629cff lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309691.323887:0:16593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 6 00000100:00100000:3.0:1788309691.323894:0:16593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c89f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+15:2353:x1875178192761728:12345-192.168.202.55@tcp:4:dd.0 00010000:00010000:0.0:1788309691.323898:0:16594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788309691.323907:0:16593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004aca722b/0x63a04852f4629d06 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309691.323907:0:16594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788309691.323914:0:16594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd837b78/0x63a04852f4629cff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309691.323926:0:16594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd837b78/0x63a04852f4629cff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309691.325064:0:16593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788309691.325071:0:16593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788309691.325078:0:16593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004aca722b/0x63a04852f4629d06 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309691.325092:0:16593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004aca722b/0x63a04852f4629d06 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309691.330859:0:15050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 7 00000100:00100000:0.0:1788309691.330879:0:15050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c89fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+17:2353:x1875178192761856:12345-192.168.202.55@tcp:4:dd.0 00010000:00010000:0.0:1788309691.330932:0:15050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9ad6293/0x63a04852f4629d0d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309691.330955:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788309691.330960:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788309691.330969:0:15050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9ad6293/0x63a04852f4629d0d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309691.330985:0:15050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9ad6293/0x63a04852f4629d0d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788309691.375019:0:7639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934602 is committed 00002000:00010000:3.0:1788309691.376780:0:16595:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 5242880 -> 7654321 00002000:00010000:3.0:1788309691.376790:0:16595:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 10247 00010000:00010000:3.0:1788309691.376809:0:16595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074d7d98e/0x63a04852f4629cf1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309691.376823:0:16595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074d7d98e/0x63a04852f4629cf1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309691.376833:0:16595:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074d7d98e/0x63a04852f4629cf1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309691.376842:0:16595:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8f5549e00 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:3.0:1788309691.376865:0:16595:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074d7d98e/0x63a04852f4629cf1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309691.376874:0:16595:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074d7d98e/0x63a04852f4629cf1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309691.376897:0:16595:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074d7d98e/0x63a04852f4629cf1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309691.376905:0:16595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074d7d98e/0x63a04852f4629cf1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309691.376992:0:16595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecdc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+19:2352:x1875178192761344:12345-192.168.202.55@tcp:4:dd.0 Request processed in 97557us (126246us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1788309691.377002:0:16595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 3 00002000:00010000:0.0:1788309691.377632:0:16596:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 12295 00010000:00010000:0.0:1788309691.377644:0:16596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e3f1a1b/0x63a04852f4629cf8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309691.377653:0:16596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009e3f1a1b/0x63a04852f4629cf8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309691.377672:0:16596:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009e3f1a1b/0x63a04852f4629cf8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309691.377678:0:16596:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8ecf2ee00 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:0.0:1788309691.377681:0:16596:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009e3f1a1b/0x63a04852f4629cf8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309691.377688:0:16596:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009e3f1a1b/0x63a04852f4629cf8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309691.377700:0:16596:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009e3f1a1b/0x63a04852f4629cf8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309691.377707:0:16596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e3f1a1b/0x63a04852f4629cf8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309691.377754:0:16596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecdc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+17:2353:x1875178192761472:12345-192.168.202.55@tcp:4:dd.0 Request processed in 86677us (119671us total) trans 8589934602 rc 0/0 00000100:00100000:0.0:1788309691.377761:0:16596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 4 00000001:00080000:1.0:1788309691.412717:0:7639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00000001:00080000:1.0:1788309691.412745:0:7639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00002000:00010000:3.0:1788309691.412846:0:16594:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 16391 00010000:00010000:3.0:1788309691.412866:0:16594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd837b78/0x63a04852f4629cff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309691.412881:0:16594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd837b78/0x63a04852f4629cff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309691.412891:0:16594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fd837b78/0x63a04852f4629cff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309691.412900:0:16594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8ecf2e400 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:3.0:1788309691.412905:0:16594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd837b78/0x63a04852f4629cff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309691.412932:0:16594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd837b78/0x63a04852f4629cff lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309691.412957:0:16594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fd837b78/0x63a04852f4629cff lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309691.412965:0:16594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd837b78/0x63a04852f4629cff lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309691.413072:0:16594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecdc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+9:2353:x1875178192761600:12345-192.168.202.55@tcp:4:dd.0 Request processed in 89218us (154092us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1788309691.413084:0:16594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 5 00010000:00010000:3.0:1788309691.413368:0:15050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9ad6293/0x63a04852f4629d0d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309691.413379:0:15050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9ad6293/0x63a04852f4629d0d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309691.413386:0:15050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9ad6293/0x63a04852f4629d0d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309691.413392:0:15050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8ecf2e600 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:3.0:1788309691.413396:0:15050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9ad6293/0x63a04852f4629d0d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309691.413414:0:15050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9ad6293/0x63a04852f4629d0d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309691.413424:0:15050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9ad6293/0x63a04852f4629d0d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309691.413432:0:15050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9ad6293/0x63a04852f4629d0d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309691.413466:0:15050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c89fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+7:2353:x1875178192761856:12345-192.168.202.55@tcp:4:dd.0 Request processed in 82594us (134616us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1788309691.413473:0:15050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 7 00010000:00010000:0.0:1788309691.414145:0:16593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004aca722b/0x63a04852f4629d06 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309691.414166:0:16593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004aca722b/0x63a04852f4629d06 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309691.414185:0:16593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004aca722b/0x63a04852f4629d06 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309691.414193:0:16593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c8d73ef000 already unused, calling callback (ffffffffc17ff230) 00010000:00010000:0.0:1788309691.414196:0:16593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004aca722b/0x63a04852f4629d06 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309691.414204:0:16593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004aca722b/0x63a04852f4629d06 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309691.414216:0:16593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004aca722b/0x63a04852f4629d06 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309691.414223:0:16593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004aca722b/0x63a04852f4629d06 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309691.414460:0:16593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c89f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+5:2353:x1875178192761728:12345-192.168.202.55@tcp:4:dd.0 Request processed in 90563us (151626us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1788309691.414467:0:16593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 6 00010000:00010000:2.0:1788309692.064443:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788309692.901927:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecdc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875178210569088:0@lo:400:kworker.0 00000100:00100000:3.0:1788309692.902001:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309692.902195:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecdc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a1139bce-bc3d-41b1-9121-b11888b6dcf4:3303:1875178210568704:0@lo:400:kworker.0 00000100:00100000:1.0:1788309692.905661:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309692.905733:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecdc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875178210569216:0@lo:400:kworker.0 00000100:00100000:1.0:1788309692.905772:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309692.905822:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210568704 00000100:00100000:1.0:1788309692.905830:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210568704 00000100:00100000:1.0:1788309692.905879:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788309692.905889:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ee539c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1139bce-bc3d-41b1-9121-b11888b6dcf4+19:3303:x1875178210568704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309692.905945:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ee539c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1139bce-bc3d-41b1-9121-b11888b6dcf4+19:3303:x1875178210568704:12345-0@lo:400:kworker.0 Request processed in 58us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309692.905953:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788309692.905991:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210569088 00000100:00100000:1.0:1788309692.905995:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210569088 00000100:00100000:1.0:1788309692.906039:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210569216 00000100:00100000:1.0:1788309692.906042:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210569216 00000100:00100000:1.0:1788309692.906078:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788309692.906085:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8ecdc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875178210569088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309692.906117:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8ecdc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875178210569088:12345-0@lo:400:kworker.0 Request processed in 33us (4117us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309692.906149:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1788309692.906151:0:14358:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788309692.906166:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788309692.906175:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c89faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875178210569216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309692.906200:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c89faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875178210569216:12345-0@lo:400:kworker.0 Request processed in 28us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309692.906206:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788309692.906239:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecdc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a1139bce-bc3d-41b1-9121-b11888b6dcf4:3303:1875178210568704:0@lo:400:kworker.0 00000100:00100000:1.0:1788309692.906251:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecdc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875178210569216:0@lo:400:kworker.0 00000100:00100000:2.0:1788309692.906327:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecdc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210568960:0@lo:400:kworker.0 00000100:00100000:2.0:1788309692.906358:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309692.906378:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecdc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210569472:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788309692.906393:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309692.906413:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788309692.906418:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecdc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210568832:0@lo:400:kworker.0 00000100:00100000:2.0:1788309692.906439:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309692.906457:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97c8ecdc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875178210569344:0@lo:400:kworker.0 00000100:00100000:2.0:1788309692.906470:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309692.906599:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210568960 00000100:00100000:2.0:1788309692.906667:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210568960 00000100:00100000:2.0:1788309692.906703:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210568832 00000100:00100000:2.0:1788309692.906706:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210568832 00000100:00100000:2.0:1788309692.906728:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788309692.906736:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc769180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1875178210568960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309692.906774:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc769180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1875178210568960:12345-0@lo:400:kworker.0 Request processed in 40us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309692.906780:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788309692.906792:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788309692.906798:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc768700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1875178210568832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309692.906823:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc768700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1875178210568832:12345-0@lo:400:kworker.0 Request processed in 26us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309692.906829:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788309692.906842:0:15347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210569344 00000100:00100000:2.0:1788309692.906846:0:15347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210569344 00000100:00100000:2.0:1788309692.906865:0:15347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788309692.906871:0:15347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc76a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875178210569344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309692.906899:0:15347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc76a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875178210569344:12345-0@lo:400:kworker.0 Request processed in 28us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309692.906904:0:15347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:2.0:1788309692.906917:0:14358:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788309692.906920:0:14358:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788309692.906922:0:14358:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788309692.907023:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecdc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210568832:0@lo:400:kworker.0 00000100:00100000:2.0:1788309692.907032:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecdc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875178210569344:0@lo:400:kworker.0 00000100:00100000:2.0:1788309692.907040:0:3301:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:2.0:1788309692.907044:0:3301:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97c8fc577480, transno 8589934595 00000004:00080000:2.0:1788309692.907055:0:3301:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:2.0:1788309692.907074:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecdc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210568960:0@lo:400:kworker.0 00000100:00100000:2.0:1788309692.914900:0:15049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178210569472 00000100:00100000:2.0:1788309692.914914:0:15049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178210569472 00000100:00100000:2.0:1788309692.914994:0:15049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788309692.915005:0:15049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8fc76ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875178210569472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788309692.915046:0:15049:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1788309692.915156:0:15049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8fc76ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875178210569472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 153us (8761us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309692.915163:0:15049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788309692.915213:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecdc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875178210569472:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788309692.919231:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97c8ecdc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875178210569088:0@lo:400:kworker.0 00000001:02000400:1.0:1788309693.006963:0:16635:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:0.0:1788309693.089517:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788309693.380875:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309693.380923:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309693.380965:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309693.380996:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309693.381021:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309693.381040:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309693.381062:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788309693.381101:0:16007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192762240 00000100:00100000:1.0:1788309693.381112:0:16007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192762240 00000100:00100000:1.0:1788309693.381181:0:16007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192762752 00000100:00100000:1.0:1788309693.381185:0:16007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192762752 00000100:00100000:1.0:1788309693.381201:0:16007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192762368 00000100:00100000:1.0:1788309693.381204:0:16007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192762368 00000100:00100000:1.0:1788309693.381216:0:16007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192762624 00000100:00100000:1.0:1788309693.381218:0:16007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192762624 00000100:00100000:1.0:1788309693.381232:0:16007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 18 00000100:00100000:1.0:1788309693.381243:0:16007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8c89f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+5:2351:x1875178192762240:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788309693.381472:0:16007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8c89f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+5:2351:x1875178192762240:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 229us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309693.381480:0:16007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 18 00000100:00100000:2.0:1788309693.382059:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192761984 00000100:00100000:2.0:1788309693.382064:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192761984 00000100:00100000:2.0:1788309693.382375:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 124 00000100:00100000:2.0:1788309693.382385:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8d6851c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2082d80-0399-454d-94d0-622e1b077a92+13:2351:x1875178192761984:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:2.0:1788309693.382422:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8d6851c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2082d80-0399-454d-94d0-622e1b077a92+13:2351:x1875178192761984:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 39us (1558us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309693.382428:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 124 00000100:00100000:0.0:1788309693.382554:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192762496 00000100:00100000:0.0:1788309693.382559:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192762496 00000100:00100000:0.0:1788309693.382593:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178192762112 00000100:00100000:0.0:1788309693.382596:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178192762112 00000100:00100000:0.0:1788309693.382622:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 32 00000100:00100000:3.0:1788309693.382629:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 19 00000100:00100000:0.0:1788309693.382632:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8efefbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58cbd1af-e5b9-4e74-a0c2-c243cb2213cd+6:2351:x1875178192762496:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788309693.382647:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8efef9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:58cbd1af-e5b9-4e74-a0c2-c243cb2213cd+5:2351:x1875178192762752:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788309693.382683:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8efef9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:58cbd1af-e5b9-4e74-a0c2-c243cb2213cd+5:2351:x1875178192762752:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 44us (1687us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309693.382690:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 19 00000100:00100000:0.0:1788309693.382696:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8efefbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58cbd1af-e5b9-4e74-a0c2-c243cb2213cd+6:2351:x1875178192762496:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 64us (1728us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309693.382705:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 32 00000100:00100000:3.0:1788309693.382710:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 20 00000100:00100000:3.0:1788309693.382719:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8efef8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+5:2351:x1875178192762368:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788309693.382745:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 33 00000100:00100000:3.0:1788309693.382746:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8efef8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+5:2351:x1875178192762368:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 27us (1703us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309693.382760:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8efef9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+20:2351:x1875178192762112:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788309693.382766:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 20 00000100:00100000:3.0:1788309693.382782:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 21 00000100:00100000:3.0:1788309693.382789:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8efefb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:58cbd1af-e5b9-4e74-a0c2-c243cb2213cd+5:2351:x1875178192762624:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788309693.382798:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8efef9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fcd26c6-50ab-4098-99a3-ad6ed6abb600+20:2351:x1875178192762112:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 43us (1774us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309693.382806:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 33 00000100:00100000:3.0:1788309693.382819:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8efefb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:58cbd1af-e5b9-4e74-a0c2-c243cb2213cd+5:2351:x1875178192762624:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 30us (1755us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309693.382825:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 21 00000100:00080000:3.0:1788309693.382874:0:14358:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788309693.382879:0:14358:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788309693.382881:0:14358:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788309694.116709:0:14351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29549 lines, 29549 kept, 0 dropped, 0 bad.